-- Logs begin at Thu 2022-05-26 17:04:06 UTC, end at Thu 2022-05-26 18:18:51 UTC. -- May 26 17:51:52.046321 dv-cinder-836074-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 26 17:51:52.055767 dv-cinder-836074-5-iscsi devstack@n-api.service[103095]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 26 17:51:52.059168 dv-cinder-836074-5-iscsi devstack@n-api.service[103095]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 26 17:51:52 2022] *** May 26 17:51:52.059168 dv-cinder-836074-5-iscsi devstack@n-api.service[103095]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 26 17:51:52.059168 dv-cinder-836074-5-iscsi devstack@n-api.service[103095]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 26 17:51:52.059168 dv-cinder-836074-5-iscsi devstack@n-api.service[103095]: nodename: dv-cinder-836074-5-iscsi May 26 17:51:52.059168 dv-cinder-836074-5-iscsi devstack@n-api.service[103095]: machine: x86_64 May 26 17:51:52.059168 dv-cinder-836074-5-iscsi devstack@n-api.service[103095]: clock source: unix May 26 17:51:52.059168 dv-cinder-836074-5-iscsi devstack@n-api.service[103095]: pcre jit disabled May 26 17:51:52.059168 dv-cinder-836074-5-iscsi devstack@n-api.service[103095]: detected number of CPU cores: 4 May 26 17:51:52.059168 dv-cinder-836074-5-iscsi devstack@n-api.service[103095]: current working directory: / May 26 17:51:52.059168 dv-cinder-836074-5-iscsi devstack@n-api.service[103095]: detected binary path: /usr/bin/uwsgi-core May 26 17:51:52.059168 dv-cinder-836074-5-iscsi devstack@n-api.service[103095]: your processes number limit is 47680 May 26 17:51:52.059168 dv-cinder-836074-5-iscsi devstack@n-api.service[103095]: your memory page size is 4096 bytes May 26 17:51:52.059168 dv-cinder-836074-5-iscsi devstack@n-api.service[103095]: detected max file descriptor number: 2048 May 26 17:51:52.059168 dv-cinder-836074-5-iscsi devstack@n-api.service[103095]: lock engine: pthread robust mutexes May 26 17:51:52.059168 dv-cinder-836074-5-iscsi devstack@n-api.service[103095]: thunder lock: enabled May 26 17:51:52.059168 dv-cinder-836074-5-iscsi devstack@n-api.service[103095]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 26 17:51:52.059168 dv-cinder-836074-5-iscsi devstack@n-api.service[103095]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 26 17:51:52.104260 dv-cinder-836074-5-iscsi devstack@n-api.service[103095]: Python main interpreter initialized at 0x55ebbf36d9c0 May 26 17:51:52.104260 dv-cinder-836074-5-iscsi devstack@n-api.service[103095]: python threads support enabled May 26 17:51:52.104260 dv-cinder-836074-5-iscsi devstack@n-api.service[103095]: your server socket listen backlog is limited to 100 connections May 26 17:51:52.104260 dv-cinder-836074-5-iscsi devstack@n-api.service[103095]: your mercy for graceful operations on workers is 90 seconds May 26 17:51:52.104802 dv-cinder-836074-5-iscsi devstack@n-api.service[103095]: mapped 403077 bytes (393 KB) for 2 cores May 26 17:51:52.104802 dv-cinder-836074-5-iscsi devstack@n-api.service[103095]: *** Operational MODE: preforking *** May 26 17:51:52.105008 dv-cinder-836074-5-iscsi devstack@n-api.service[103095]: *** uWSGI is running in multiple interpreter mode *** May 26 17:51:52.105008 dv-cinder-836074-5-iscsi devstack@n-api.service[103095]: spawned uWSGI master process (pid: 103095) May 26 17:51:52.105244 dv-cinder-836074-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 26 17:51:52.106611 dv-cinder-836074-5-iscsi devstack@n-api.service[103095]: spawned uWSGI worker 1 (pid: 103096, cores: 1) May 26 17:51:52.106611 dv-cinder-836074-5-iscsi devstack@n-api.service[103095]: spawned uWSGI worker 2 (pid: 103097, cores: 1) May 26 17:51:52.106611 dv-cinder-836074-5-iscsi devstack@n-api.service[103095]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 26 17:51:53.327035 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 17:51:53.330344 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 17:51:54.080611 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 17:51:54.080611 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: from cryptography.utils import int_from_bytes May 26 17:51:54.080878 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 17:51:54.080878 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: from cryptography.utils import int_from_bytes May 26 17:51:54.335347 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 17:51:54.335347 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: from cryptography.utils import int_from_bytes May 26 17:51:54.335945 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 17:51:54.335945 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: from cryptography.utils import int_from_bytes May 26 17:51:56.750315 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 17:51:56.750895 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 17:51:56.751112 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 17:51:56.751487 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 17:51:56.751750 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 17:51:56.752187 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.752527 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.752858 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.753186 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.753528 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.753846 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.754175 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.754502 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.755446 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.755446 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.755446 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.755823 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836074-5-iscsi {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.756666 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.756933 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.757323 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.757596 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.757912 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.758245 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.758561 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.759075 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.759791 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.760146 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.760471 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.760835 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.762352 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.762352 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.762352 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.762352 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.762352 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.762930 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.763070 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836074-5-iscsi {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.763387 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.763708 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.764089 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.764487 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.764906 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.765216 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.765637 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.765944 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.766304 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.766304 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.766993 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.766993 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.767602 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.767602 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.768253 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.768253 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.769044 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.769044 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.769499 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.769746 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.769974 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.770611 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.770611 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.771122 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.771366 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.771601 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.772473 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.772972 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.773485 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.773816 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.774119 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.774440 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.774760 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.775087 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.775406 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.775725 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.776077 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.776407 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.776743 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.777060 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.777391 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.777809 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.69 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.778070 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.69 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.778393 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.778746 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.779074 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.779396 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.779726 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.780106 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.780390 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.780721 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.781037 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.781364 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.781691 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.782010 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.782273 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.782582 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.782894 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.783231 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.783542 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.783861 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.784199 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.784521 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.784829 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.785147 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.785466 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.785780 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.786089 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.786406 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.786723 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.787046 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.787405 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.787789 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.788235 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.788550 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.788868 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.789189 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.789504 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.789833 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.790145 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.790463 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.790796 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.791112 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.791423 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.791753 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.792093 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.792410 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.792731 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.793047 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.793363 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.793687 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.794009 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.794327 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.794633 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.794947 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.795260 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.795577 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.795888 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.796224 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.796536 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.796865 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.797198 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.797515 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.797836 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.798152 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.798480 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.798823 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.799169 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.799516 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.799845 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.800213 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.800555 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.800881 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.801267 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.801495 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.801829 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.802147 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.802467 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.802783 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.803322 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.803666 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.804008 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.804309 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 17:51:56.805202 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.805450 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 17:51:56.805686 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.805686 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.806120 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 17:51:56.806351 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.806582 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 17:51:56.806836 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.807075 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 17:51:56.807340 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.807564 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.807783 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.808066 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.808314 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.808494 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.808687 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.808841 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.808988 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.809136 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.809311 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.809534 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.809768 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.809991 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.810205 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.810450 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.810692 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.810929 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.811153 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.811568 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.811809 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.812061 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.812303 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.812537 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836074-5-iscsi {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.812776 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.812992 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.813225 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.813451 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.813693 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.813911 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.814112 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.814328 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.814564 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.814783 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.814998 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.815413 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.815635 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.815855 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.816165 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.816316 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.816532 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.817011 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.817250 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.817488 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.817728 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.817961 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.818189 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.818423 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.819199 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.819448 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.819681 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.819918 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.820414 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.820661 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.820887 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.821128 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.821361 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.821361 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.821983 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.822144 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.822374 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.822535 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.822712 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836074-5-iscsi {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.822941 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.823188 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.823437 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.823675 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.823904 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.824201 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.824358 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.824513 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.824658 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.824799 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.825016 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.825247 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.825654 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.825908 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.826146 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.826402 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.826634 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.826863 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.827104 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.827343 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.827568 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.827797 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.828046 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.828274 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.828522 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.828756 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.828991 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.829231 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.829459 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.829696 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.830061 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.830291 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.830517 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.830749 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.830979 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.831208 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.831455 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.831709 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.832117 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.832352 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.832597 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.832846 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.833096 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.833319 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.833470 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.833613 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.833825 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.834071 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.834878 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.835115 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.835541 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.835913 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.836208 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.836435 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.836661 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.836911 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.836911 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.837368 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.837618 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.837850 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.838099 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.838332 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.838578 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.838762 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.838981 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.839213 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.839462 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.839691 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.839926 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.840210 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.840455 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.840687 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.840923 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.841098 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.841303 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.841546 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.841778 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.842067 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.842412 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.842667 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.842897 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.843134 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.843134 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.843648 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.69 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.843648 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.69 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.844159 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.844391 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.844638 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.844638 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.845105 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.845354 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.845587 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.845814 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.846206 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.846445 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.846694 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.846926 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.847158 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.847386 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.847639 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.847880 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.848128 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.848128 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.848506 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.848741 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.848991 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.849226 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.849458 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.849710 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.849988 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.850220 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.850465 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.850713 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.850945 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.851179 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.851510 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.851767 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.852000 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.852321 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.852707 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.852945 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.853191 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.853449 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.853685 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.853870 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.854115 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.854348 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.854581 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.854840 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.855076 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.855272 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.855453 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.855686 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.855920 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.856233 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.856587 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.856824 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.857057 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.857300 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.857648 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.857884 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.858135 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.858379 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.858379 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.858822 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.859066 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.859306 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.859537 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.859768 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.859998 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.860288 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.860456 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.860632 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.860841 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.861071 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.861305 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.861536 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.861779 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.862025 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.862257 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.862482 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.862841 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.863106 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.863373 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.863607 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.863840 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.864113 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.864352 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.864584 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.864831 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.865053 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.865303 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.865649 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.865883 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.866137 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.866388 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.866734 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.866889 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.867110 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.867376 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.867627 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.867874 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.868154 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.868394 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.868617 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.868861 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.869109 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.869346 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.869580 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.869813 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.870045 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.870274 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.870515 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.870723 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.870957 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.871192 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.871423 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.871659 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.871882 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.872058 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.872273 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.872505 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.872738 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.873138 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.873373 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.873619 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.873879 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.874113 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.874347 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.874602 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:51:56.874838 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.875083 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.875303 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.875492 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.875723 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.875973 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.876243 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.876550 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.876761 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.877056 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.877314 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.877548 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.877782 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.878024 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.878266 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.878511 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.878757 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.878989 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.879224 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.879463 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.879715 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.879974 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.880294 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.880524 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.880751 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.880983 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.881749 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.881991 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.882223 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.882446 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.882678 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.882910 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.883280 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.883549 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.883723 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.883936 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.884119 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.884536 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.884758 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.885009 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.885240 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.885471 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.885713 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.885944 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.886171 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.886429 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.886659 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.886888 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.887251 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.887494 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.887735 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.887982 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.888279 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.888508 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.888737 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.888968 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.889208 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.889439 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.889684 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.889911 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.890140 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.890374 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.890618 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.890858 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.891086 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.891331 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.891561 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.891789 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.892057 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.892293 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.892521 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.892748 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.892899 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.893041 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.893298 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.893655 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.893887 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.894120 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.894120 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.894592 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.894825 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.895053 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.895287 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.895529 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.895807 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.896098 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.896258 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.896436 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.896702 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.897588 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.897824 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.898093 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.898347 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.898581 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.898813 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.899052 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.899277 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.899631 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.899889 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.900153 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.900393 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.900629 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.900870 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.901107 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.901348 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.901348 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.901814 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.902047 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.902276 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.902276 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.902769 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.903005 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.903237 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.903467 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.903732 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.903934 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.904246 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.904489 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.904731 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.904959 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.905191 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.905426 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.905624 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.905769 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.905911 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.906113 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.906349 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.906590 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.906825 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.907051 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.907285 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.907538 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.907874 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.908082 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.908274 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.908516 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.908748 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.908976 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.909222 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.909457 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.909980 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.910214 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.910466 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.910703 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.910952 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.911181 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.911414 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.911631 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.911867 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.911867 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.912399 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.912399 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.912839 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.913073 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.913318 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.913318 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.913737 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.913979 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.914214 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.914214 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.914664 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.914909 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.915141 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.915368 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.915600 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.915844 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.916149 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.916402 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.916652 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.916909 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.917212 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.917439 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.917680 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.918094 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.918328 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.918556 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.918713 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.918857 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.919010 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.919168 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.919312 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.919454 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.919595 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.919736 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.919910 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.920086 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.920247 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.920453 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.920668 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.920668 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.920961 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.921105 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.921246 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.921452 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.921681 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.921921 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.922171 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.922398 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.922651 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.922880 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.923109 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.923327 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.923572 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.923572 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.923953 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.924245 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.924479 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.924719 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.924962 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.925196 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.925196 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.925651 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.925877 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.926132 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.926367 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.926599 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.926829 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.927061 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.927243 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.927441 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.927675 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.927960 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.928229 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.928480 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.928735 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.928999 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.929249 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.929485 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.929678 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.929823 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.930059 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.930284 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.930523 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.930757 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.931000 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.931235 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.931481 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.931738 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.931973 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.932246 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.932481 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.932716 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.932973 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.933204 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.933417 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.933569 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.933751 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.933990 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.934237 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.934471 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.934720 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.934960 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.935205 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.935458 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.935696 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.935933 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.936196 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.936432 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.936671 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.936923 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.937174 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.937394 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.937641 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.937876 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.938113 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.938361 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.938593 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.938828 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.939007 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.939166 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.939393 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.939640 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.939876 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.940162 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.940395 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.940531 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.940686 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.940950 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.941120 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.941289 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.941389 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.941471 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.941568 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.941651 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.941718 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.941718 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.941874 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.941959 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.942037 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.942105 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.942178 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.942245 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.942310 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.942374 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.942448 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.942528 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.942595 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.942659 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.942723 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.942788 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.942861 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.942940 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.943007 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.943072 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.943137 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.943209 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.943284 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.943351 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.943416 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.943497 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.944123 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.944306 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.944425 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.944504 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.944586 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.944655 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.944720 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.944796 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.944864 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.944864 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.944982 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.945060 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.945129 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.945208 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.945275 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.945340 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.945405 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.945470 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.945544 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.945611 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.945684 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.945684 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.945811 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.945811 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.945940 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.946016 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.946084 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.946158 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.946228 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.946302 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.946377 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.946453 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.946520 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.946585 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.946670 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.946744 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.946818 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.946893 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.946966 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.947033 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.947097 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.947170 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.947238 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.947303 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.947397 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.947463 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.947528 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.947602 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.947671 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.947736 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.947800 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.947865 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.947931 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.948009 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.948109 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.948189 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.948258 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.948323 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.948394 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.948491 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.948561 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.948633 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.948707 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.948781 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.948859 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.948935 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.949022 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.949090 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.949155 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.949226 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.949300 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.949368 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.949441 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.949509 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.949573 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.949638 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.949731 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.949801 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.949866 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.949933 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.949998 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.950063 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.950136 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.950211 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.950296 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.950296 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.950427 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.950427 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.950562 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.950628 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.950692 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.950756 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.950826 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.950904 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.950972 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.951037 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.951102 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.951167 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.951242 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.951316 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.951395 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.951470 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.951544 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.951611 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.951684 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.951752 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.951838 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.951913 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.951980 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.952393 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.952486 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.952564 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.952641 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.952709 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.952775 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.952839 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.952904 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.952968 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.953045 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.953113 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.953178 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.953243 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.953307 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.953381 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.953381 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.953499 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.953563 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.953627 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.953692 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.953763 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.953849 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.953915 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.953981 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.954045 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.954116 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.954264 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.954341 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.954407 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.954472 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.954537 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.954602 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.954674 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.954741 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.954813 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.954879 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.954950 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.955029 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.955107 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.955174 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.955239 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.955303 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.955367 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.955441 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.955514 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.955593 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.955660 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.955737 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.955804 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.955877 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.955950 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.956052 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.956137 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.956213 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.956288 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.956356 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.956420 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.956485 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.956556 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.956624 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.956697 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.956772 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.956838 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.956911 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.956985 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.957052 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.957130 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.957199 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.957263 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.957328 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.957328 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.957457 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.957532 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.957598 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.957663 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.957727 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.957791 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.957862 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.957940 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.958007 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.958071 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.958135 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.958200 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.958276 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.958343 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.958416 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.958494 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.958561 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.958625 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.958703 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.958771 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.958771 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.958887 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.958951 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.959015 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.959089 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.959171 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.959853 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.959924 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.959989 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.960114 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.960193 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.960260 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.960326 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.960390 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.960455 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.960532 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.960600 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.960664 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.960729 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.960793 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.960859 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.960935 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.961003 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.961074 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.961141 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.961205 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.961276 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.961350 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.961425 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.961492 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.961559 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.961624 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.961689 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.961762 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.961829 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.961894 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.961960 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.962031 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.962106 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.962173 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.962238 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.962335 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.962591 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.962665 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.962746 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.962814 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.962879 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.962943 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.963009 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.963073 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.963146 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.963222 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.963296 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.963363 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.963439 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.963515 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.963582 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.963653 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.963719 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.963783 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.963848 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.963921 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.963989 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.963989 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.964155 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.964232 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.964300 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.964300 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.964428 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.964428 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.964561 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.964561 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.964704 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.964771 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.964843 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.964917 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.964985 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.965049 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.965127 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.965194 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.965267 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.965267 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.965396 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.965462 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.965527 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.965592 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.965665 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.965740 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.965807 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.965879 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.965946 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.966010 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.966087 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.966162 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.966228 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.966228 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.966346 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.966411 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.966493 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.966780 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.967261 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.967342 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.967342 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.967474 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.967549 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.967549 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.967669 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.967742 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.967816 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.967883 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.967956 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.968075 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.968151 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.968217 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.968294 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.968375 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.968510 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.968601 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.968669 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.968734 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.968734 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.968898 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.968979 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.969059 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.969137 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.969216 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.969303 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.969371 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.969444 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.969523 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.969590 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.969656 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.969730 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.969730 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.969856 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.969930 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.969930 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.970055 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.970131 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.970204 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.970271 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.970336 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.970401 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.970401 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.970527 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.970600 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.970600 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.970727 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.970795 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.970868 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.970951 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.971025 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.971098 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.971098 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.971224 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.971306 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.971380 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.971446 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.971517 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.971591 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.971674 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.971755 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.971829 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.971908 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.971976 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.972152 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.972249 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.972320 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.972408 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.972501 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.972501 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.972900 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.973007 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.973090 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.973158 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.973224 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.973289 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.973353 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.973439 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.973439 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.973572 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.973647 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.973647 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.973647 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.973879 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.973948 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.974013 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.974013 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.974203 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.974286 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.974361 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.974434 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.974506 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.974571 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.974644 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.974723 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.974818 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.974901 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.974969 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.975040 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.975106 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.975180 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.975246 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.975246 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.975363 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.975427 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.975492 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.975565 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.975632 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.975696 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.975768 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.975834 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.975834 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.975834 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.976027 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.976099 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.976206 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.976330 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.976432 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.976503 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.976568 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.976642 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.976642 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.976775 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.976850 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.976850 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.976968 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.977033 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.977097 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.977161 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.977304 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.977395 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.977470 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.977545 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.977545 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.977678 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.977745 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.977810 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.977874 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.977874 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.977999 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.978072 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.978158 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.978227 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.978317 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.978396 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.978473 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.978603 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.978603 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.978746 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.978812 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.978878 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.978942 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.978942 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.979075 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.979141 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.979206 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.979270 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.979343 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.979416 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.979416 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.979541 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.979615 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.979615 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.979748 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.979816 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.979881 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.979945 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.980009 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.980009 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.980263 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.980345 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.980412 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.980485 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.980560 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.980627 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.980774 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.980856 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.980923 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.980989 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.981054 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.981135 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.981223 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.981293 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.981367 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.981433 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.981505 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.981584 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.981651 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.981716 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.981781 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.981846 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.981918 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.982009 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.982084 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.982151 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.982216 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.982281 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.982346 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.982419 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.982487 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.982566 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.982644 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.982730 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.982836 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.982905 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.982978 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.983046 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.983111 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.983176 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.983378 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.983471 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.983693 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.983784 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.984043 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.984149 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.984393 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.984484 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.984703 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.984791 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.985032 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.985130 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.985351 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.985439 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.985672 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.985759 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.985993 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.986103 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.986310 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.986398 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.986627 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.986722 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.986946 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.987042 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.987270 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.987369 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.987589 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.987681 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.987913 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.988001 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.988253 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.988341 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.988565 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.988693 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.988875 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.989014 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.989193 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.989342 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.989504 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.989668 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.989815 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.989993 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.990125 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.990325 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.990480 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.990696 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.990798 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.991018 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.991279 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.991365 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.991652 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.991783 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.991989 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.992183 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.992365 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.992454 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.992703 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.992800 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.993096 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.993199 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.993346 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.993496 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.993657 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.993758 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.993967 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.994062 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.994284 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.994372 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.994610 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.994709 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.994925 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.995019 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.995237 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.995327 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.995547 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.995635 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.995864 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.995958 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.996200 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.996290 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.996515 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.996634 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.996826 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.996914 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.997138 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.997225 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.997456 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.997542 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.997764 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.997860 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.998076 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.998163 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.998386 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.998475 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.998696 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.998783 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.999005 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.999101 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.999316 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.999403 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.999633 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.999725 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:56.999947 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.000122 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.000287 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.000600 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.000704 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.000888 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.000976 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.001197 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.001284 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.001518 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.001605 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.001838 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.001925 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.002177 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.002279 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.002474 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.002570 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.002792 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.002888 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.003109 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.003256 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.003424 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.003513 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.003738 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.003839 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.004092 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.004183 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.004420 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.004521 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.004737 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.004834 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.005076 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.005163 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.005394 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.005482 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.005712 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.005798 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.006027 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.006641 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.007002 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.007092 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.007448 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.007555 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.007831 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.007936 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.008277 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.008467 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.008599 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.008865 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.008968 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.009232 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.009592 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.009812 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.010038 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.010165 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.010385 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.010488 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.010721 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.010833 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.011044 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.011154 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.011359 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.011461 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.011676 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.011791 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.011991 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.012253 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.012339 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.012418 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.012652 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.012758 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.012974 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.013079 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.013292 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.013410 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.013646 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.013790 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.013918 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.014047 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.014263 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.014478 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.014597 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.014802 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.015010 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.015145 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.015353 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.015465 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.015688 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.015780 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.016069 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.016168 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.016399 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.016518 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.016755 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.016862 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.017074 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.017177 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.017415 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.017575 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.017691 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.017780 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.018007 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.018109 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.018254 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 17:51:57.018347 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.018620 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.018934 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.019244 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.019567 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.020323 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.020444 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.020799 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.021181 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.021454 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.022392 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.022687 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.022995 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.023324 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.023639 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.023957 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.024296 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.024616 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.024918 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.025228 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.025544 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.025863 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.026169 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.026483 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.026788 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.027123 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.027427 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.027731 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.028078 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.028375 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.028689 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.028993 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.029307 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.029613 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.029929 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.030239 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.030543 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.030855 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.031167 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.031476 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.031793 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.032179 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.032507 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.032819 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.033135 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.033454 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.033775 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.034088 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.034397 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.034712 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.035063 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.035386 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.035961 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.036324 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.036654 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.036995 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.037974 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.038287 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.038602 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.038917 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.039246 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.039560 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.039876 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.040218 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.040517 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.040834 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.041149 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.041461 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.041779 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.042092 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.042403 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.042718 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.043031 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.043343 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.043660 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.044009 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.044354 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.044676 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.044992 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.045317 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.045632 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.045943 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.046258 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.046574 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.046893 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.047231 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.047548 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.047851 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.048322 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.048648 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.048976 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.049296 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.049616 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.049936 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.050272 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.050583 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.050911 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.051230 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.051557 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.051904 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.052288 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.052592 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.052925 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.053991 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.054355 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.054682 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.055006 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.055321 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.055632 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.055942 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.056283 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.056594 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.056906 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.057220 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.057531 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.057845 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.058154 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.058461 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.058768 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.059077 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.059381 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.059688 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.060002 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.060335 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.060650 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.060954 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.061263 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.061571 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.061907 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.062246 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.062570 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.062898 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.063210 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.063536 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.063846 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.064199 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.064528 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.064851 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.065164 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.065500 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.065813 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.066126 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.066440 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.066753 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.067068 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.067387 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.067716 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.068059 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.068371 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.068753 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.069078 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.069405 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.069726 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.070037 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.070370 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.070683 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.071001 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.071315 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.071630 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.071942 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.072291 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.072612 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.072941 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.073268 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.073584 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.073913 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.074252 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.074618 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.074916 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.075264 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.075597 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.075912 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.076250 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.076559 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:51:57.076804 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103096) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 17:51:57.088749 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: INFO dbcounter [None req-9a0d1377-7352-417c-8949-05c737873196 None None] Registered counter for database nova_api May 26 17:51:57.114338 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG oslo_db.sqlalchemy.engines [None req-9a0d1377-7352-417c-8949-05c737873196 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103097) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 17:51:57.122054 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG dbcounter [-] [103097] Writer thread running {{(pid=103097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 17:51:57.138668 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: INFO dbcounter [None req-e28e153e-3016-4299-98f5-8bc92ab3783b None None] Registered counter for database nova_api May 26 17:51:57.160521 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG oslo_db.sqlalchemy.engines [None req-e28e153e-3016-4299-98f5-8bc92ab3783b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103096) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 17:51:57.168646 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG dbcounter [-] [103096] Writer thread running {{(pid=103096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 17:51:57.184642 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.context [None req-9a0d1377-7352-417c-8949-05c737873196 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),31d4fadf-23db-42ac-9fc1-5cb2101b75d4(cell1) {{(pid=103097) load_cells /opt/stack/nova/nova/context.py:464}} May 26 17:51:57.189128 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG oslo_concurrency.lockutils [None req-9a0d1377-7352-417c-8949-05c737873196 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:51:57.190786 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG oslo_concurrency.lockutils [None req-9a0d1377-7352-417c-8949-05c737873196 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:51:57.191638 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG oslo_concurrency.lockutils [None req-9a0d1377-7352-417c-8949-05c737873196 None None] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:51:57.194337 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG oslo_concurrency.lockutils [None req-9a0d1377-7352-417c-8949-05c737873196 None None] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:51:57.196511 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: INFO dbcounter [None req-9a0d1377-7352-417c-8949-05c737873196 None None] Registered counter for database nova_cell0 May 26 17:51:57.201414 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: INFO dbcounter [None req-9a0d1377-7352-417c-8949-05c737873196 None None] Registered counter for database nova_cell1 May 26 17:51:57.210377 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG oslo_db.sqlalchemy.engines [None req-9a0d1377-7352-417c-8949-05c737873196 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103097) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 17:51:57.211894 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG oslo_db.sqlalchemy.engines [None req-9a0d1377-7352-417c-8949-05c737873196 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103097) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 17:51:57.218863 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG dbcounter [-] [103097] Writer thread running {{(pid=103097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 17:51:57.220293 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG dbcounter [-] [103097] Writer thread running {{(pid=103097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 17:51:57.231872 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.context [None req-e28e153e-3016-4299-98f5-8bc92ab3783b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),31d4fadf-23db-42ac-9fc1-5cb2101b75d4(cell1) {{(pid=103096) load_cells /opt/stack/nova/nova/context.py:464}} May 26 17:51:57.236302 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG oslo_concurrency.lockutils [None req-e28e153e-3016-4299-98f5-8bc92ab3783b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:51:57.237950 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG oslo_concurrency.lockutils [None req-e28e153e-3016-4299-98f5-8bc92ab3783b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:51:57.238804 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG oslo_concurrency.lockutils [None req-e28e153e-3016-4299-98f5-8bc92ab3783b None None] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:51:57.241421 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG oslo_concurrency.lockutils [None req-e28e153e-3016-4299-98f5-8bc92ab3783b None None] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103096) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:51:57.243567 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: INFO dbcounter [None req-e28e153e-3016-4299-98f5-8bc92ab3783b None None] Registered counter for database nova_cell0 May 26 17:51:57.248035 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: INFO dbcounter [None req-e28e153e-3016-4299-98f5-8bc92ab3783b None None] Registered counter for database nova_cell1 May 26 17:51:57.257818 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG oslo_db.sqlalchemy.engines [None req-e28e153e-3016-4299-98f5-8bc92ab3783b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103096) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 17:51:57.258935 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG oslo_db.sqlalchemy.engines [None req-e28e153e-3016-4299-98f5-8bc92ab3783b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103096) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 17:51:57.266817 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG dbcounter [-] [103096] Writer thread running {{(pid=103096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 17:51:57.268264 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG dbcounter [-] [103096] Writer thread running {{(pid=103096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 17:51:57.380578 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: INFO dbcounter [None req-9a0d1377-7352-417c-8949-05c737873196 None None] Registered counter for database nova_cell0 May 26 17:51:57.389163 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG oslo_db.sqlalchemy.engines [None req-9a0d1377-7352-417c-8949-05c737873196 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103097) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 17:51:57.393779 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG dbcounter [-] [103097] Writer thread running {{(pid=103097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 17:51:57.420754 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: INFO dbcounter [None req-e28e153e-3016-4299-98f5-8bc92ab3783b None None] Registered counter for database nova_cell0 May 26 17:51:57.428584 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG oslo_db.sqlalchemy.engines [None req-e28e153e-3016-4299-98f5-8bc92ab3783b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103096) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 17:51:57.433320 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG dbcounter [-] [103096] Writer thread running {{(pid=103096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 17:51:57.742641 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: WARNING keystonemiddleware.auth_token [None req-9a0d1377-7352-417c-8949-05c737873196 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 17:51:57.750338 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: WARNING keystonemiddleware.auth_token [None req-9a0d1377-7352-417c-8949-05c737873196 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 17:51:57.759666 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: WARNING keystonemiddleware.auth_token [None req-e28e153e-3016-4299-98f5-8bc92ab3783b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 17:51:57.767681 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: WARNING keystonemiddleware.auth_token [None req-e28e153e-3016-4299-98f5-8bc92ab3783b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 17:51:58.101553 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: WARNING keystonemiddleware.auth_token [None req-9a0d1377-7352-417c-8949-05c737873196 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 17:51:58.107511 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: WARNING keystonemiddleware.auth_token [None req-9a0d1377-7352-417c-8949-05c737873196 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 17:51:58.112937 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ebbf36d9c0 pid: 103097 (default app) May 26 17:51:58.115100 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-9a0d1377-7352-417c-8949-05c737873196 None None] Calling method '>' {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:51:58.116385 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-9a0d1377-7352-417c-8949-05c737873196 None None] 10.222.0.69 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001878 May 26 17:51:58.116804 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 1/1] 10.222.0.69 () {50 vars in 788 bytes} [Thu May 26 17:51:58 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:51:58.118038 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: WARNING keystonemiddleware.auth_token [None req-e28e153e-3016-4299-98f5-8bc92ab3783b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 17:51:58.124443 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: WARNING keystonemiddleware.auth_token [None req-e28e153e-3016-4299-98f5-8bc92ab3783b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 17:51:58.129793 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ebbf36d9c0 pid: 103096 (default app) May 26 17:53:19.942414 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-9a0d1377-7352-417c-8949-05c737873196 None None] Calling method '>' {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:53:19.943592 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-9a0d1377-7352-417c-8949-05c737873196 None None] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001609 May 26 17:53:19.944130 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 2/2] 10.222.0.69 () {54 vars in 930 bytes} [Thu May 26 17:53:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:53:19.956184 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG dbcounter [-] [103096] Writing DB stats nova_api:SELECT=3 {{(pid=103096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:19.957455 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG dbcounter [-] [103096] Writing DB stats nova_cell1:SELECT=3 {{(pid=103096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:19.958183 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG dbcounter [-] [103096] Writing DB stats nova_cell0:SELECT=3 {{(pid=103096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:19.959495 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG dbcounter [-] [103096] Writing DB stats nova_cell0:SELECT=3 {{(pid=103096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:20.423656 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-69d4d92c-9ae4-4656-8d52-356012e729b1 admin admin] Calling method '>' {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:53:20.453686 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-69d4d92c-9ae4-4656-8d52-356012e729b1 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.502702 May 26 17:53:20.455205 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 1/3] 10.222.0.69 () {60 vars in 1291 bytes} [Thu May 26 17:53:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:53:22.804454 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-9a0d1377-7352-417c-8949-05c737873196 None None] Calling method '>' {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:53:22.805480 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-9a0d1377-7352-417c-8949-05c737873196 None None] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 May 26 17:53:22.805878 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 3/4] 10.222.0.69 () {54 vars in 930 bytes} [Thu May 26 17:53:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:53:22.869849 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-56a6a892-e8fd-4d99-a821-fd04995374e3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "name": "cirros256", "rxtx_factor": 1.0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "id": "c1", "os-flavor-access:is_public": true}} {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:53:22.888730 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 17:53:22.888730 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: warnings.warn(msg) May 26 17:53:22.920427 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-56a6a892-e8fd-4d99-a821-fd04995374e3 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.108398 May 26 17:53:22.920992 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 2/5] 10.222.0.69 () {64 vars in 1282 bytes} [Thu May 26 17:53:22 2022] POST /compute/v2.1/flavors => generated 407 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 17:53:22.935362 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG dbcounter [-] [103097] Writing DB stats nova_api:SELECT=3 {{(pid=103097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:22.936681 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG dbcounter [-] [103097] Writing DB stats nova_cell1:SELECT=3 {{(pid=103097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:22.937782 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG dbcounter [-] [103097] Writing DB stats nova_cell0:SELECT=3 {{(pid=103097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:22.939233 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG dbcounter [-] [103097] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:23.150977 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-26b7249e-95c7-4162-a7ab-65d36e93c42d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:53:23.153614 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 17:53:23.153614 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: warnings.warn(msg) May 26 17:53:23.219573 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-26b7249e-95c7-4162-a7ab-65d36e93c42d admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.289550 May 26 17:53:23.220860 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 4/6] 10.222.0.69 () {64 vars in 1335 bytes} [Thu May 26 17:53:22 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:53:25.561463 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-56a6a892-e8fd-4d99-a821-fd04995374e3 admin admin] Calling method '>' {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:53:25.563031 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-56a6a892-e8fd-4d99-a821-fd04995374e3 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002021 May 26 17:53:25.570703 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 3/7] 10.222.0.69 () {54 vars in 930 bytes} [Thu May 26 17:53:25 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 17:53:25.687739 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-331c2a1b-b8ff-47d0-b8ce-aa975fde695c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d1", "disk": 5, "swap": 0, "rxtx_factor": 1.0, "name": "ds512M", "ram": 512, "vcpus": 1}} {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:53:25.706382 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 17:53:25.706382 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: warnings.warn(msg) May 26 17:53:25.727174 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-331c2a1b-b8ff-47d0-b8ce-aa975fde695c admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.153953 May 26 17:53:25.727665 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 5/8] 10.222.0.69 () {64 vars in 1282 bytes} [Thu May 26 17:53:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 17:53:25.740122 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-a84231c3-1a47-42a6-9c33-fa1bd443f2f0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:53:25.741927 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 17:53:25.741927 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: warnings.warn(msg) May 26 17:53:25.778887 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-a84231c3-1a47-42a6-9c33-fa1bd443f2f0 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042509 May 26 17:53:25.779791 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 4/9] 10.222.0.69 () {64 vars in 1335 bytes} [Thu May 26 17:53:25 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:53:28.112499 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-331c2a1b-b8ff-47d0-b8ce-aa975fde695c admin admin] Calling method '>' {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:53:28.114353 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-331c2a1b-b8ff-47d0-b8ce-aa975fde695c admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002218 May 26 17:53:28.114796 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 6/10] 10.222.0.69 () {54 vars in 930 bytes} [Thu May 26 17:53:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:53:28.183810 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-16bb9db6-484b-452f-a5d1-678226e039be admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "os-flavor-access:is_public": true, "swap": 0, "ram": 1024, "disk": 10}} {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:53:28.204679 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-16bb9db6-484b-452f-a5d1-678226e039be admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.082184 May 26 17:53:28.205402 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 5/11] 10.222.0.69 () {64 vars in 1282 bytes} [Thu May 26 17:53:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 17:53:28.217834 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-a87b911f-5b56-49e7-8d37-77ed350d7e53 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:53:28.244790 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-a87b911f-5b56-49e7-8d37-77ed350d7e53 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031009 May 26 17:53:28.245576 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 7/12] 10.222.0.69 () {64 vars in 1335 bytes} [Thu May 26 17:53:28 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:53:30.587792 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-16bb9db6-484b-452f-a5d1-678226e039be admin admin] Calling method '>' {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:53:30.588837 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-16bb9db6-484b-452f-a5d1-678226e039be admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 May 26 17:53:30.589248 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 6/13] 10.222.0.69 () {54 vars in 930 bytes} [Thu May 26 17:53:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:53:30.653302 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-3652d9f2-051d-47bf-9c52-18c85350ac34 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "name": "ds2G", "id": "d3", "disk": 10, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 2, "swap": 0}} {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:53:30.673266 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-3652d9f2-051d-47bf-9c52-18c85350ac34 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076797 May 26 17:53:30.674000 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 8/14] 10.222.0.69 () {64 vars in 1282 bytes} [Thu May 26 17:53:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 17:53:30.686101 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-51919cb5-570a-4e49-9526-afbad00f8aa1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:53:30.713805 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-51919cb5-570a-4e49-9526-afbad00f8aa1 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031402 May 26 17:53:30.714406 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 7/15] 10.222.0.69 () {64 vars in 1335 bytes} [Thu May 26 17:53:30 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:53:33.055243 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-3652d9f2-051d-47bf-9c52-18c85350ac34 admin admin] Calling method '>' {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:53:33.056420 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-3652d9f2-051d-47bf-9c52-18c85350ac34 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 May 26 17:53:33.057026 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 9/16] 10.222.0.69 () {54 vars in 930 bytes} [Thu May 26 17:53:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:53:33.123351 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-1a42c94b-0b36-42f2-a8f8-27d4bdc3a5a0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "disk": 20, "ram": 4096, "name": "ds4G", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "id": "d4"}} {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:53:33.146725 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-1a42c94b-0b36-42f2-a8f8-27d4bdc3a5a0 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.083083 May 26 17:53:33.147591 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 8/17] 10.222.0.69 () {64 vars in 1282 bytes} [Thu May 26 17:53:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 17:53:33.160394 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-42a9ba3c-fb33-4962-af62-490549884a32 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:53:33.185175 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-42a9ba3c-fb33-4962-af62-490549884a32 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029091 May 26 17:53:33.192565 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 10/18] 10.222.0.69 () {64 vars in 1335 bytes} [Thu May 26 17:53:33 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:53:35.471743 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-1a42c94b-0b36-42f2-a8f8-27d4bdc3a5a0 admin admin] Calling method '>' {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:53:35.472844 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-1a42c94b-0b36-42f2-a8f8-27d4bdc3a5a0 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001553 May 26 17:53:35.473556 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 9/19] 10.222.0.69 () {54 vars in 930 bytes} [Thu May 26 17:53:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:53:35.541555 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-b8e52a0e-fb77-4ce1-bbe1-5db9d1e32840 admin admin] Calling method '>' {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:53:35.567133 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-b8e52a0e-fb77-4ce1-bbe1-5db9d1e32840 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.086646 May 26 17:53:35.567900 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 11/20] 10.222.0.69 () {60 vars in 1291 bytes} [Thu May 26 17:53:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:53:37.896001 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-1a42c94b-0b36-42f2-a8f8-27d4bdc3a5a0 admin admin] Calling method '>' {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:53:37.897091 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-1a42c94b-0b36-42f2-a8f8-27d4bdc3a5a0 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 May 26 17:53:37.897509 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 10/21] 10.222.0.69 () {54 vars in 930 bytes} [Thu May 26 17:53:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:53:37.960898 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-4f12772d-430a-474f-95ed-505f64aeb0c0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "name": "m1.tiny", "vcpus": 1, "os-flavor-access:is_public": true, "ram": 512, "id": "1", "rxtx_factor": 1.0, "swap": 0}} {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:53:37.980522 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-4f12772d-430a-474f-95ed-505f64aeb0c0 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.076450 May 26 17:53:37.981075 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 12/22] 10.222.0.69 () {64 vars in 1282 bytes} [Thu May 26 17:53:37 2022] POST /compute/v2.1/flavors => generated 402 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 17:53:37.994180 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-4950e415-9260-409f-944d-199a5e38d7dc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:53:38.017434 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-4950e415-9260-409f-944d-199a5e38d7dc admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026868 May 26 17:53:38.018134 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 11/23] 10.222.0.69 () {64 vars in 1332 bytes} [Thu May 26 17:53:37 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:53:40.307316 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-4f12772d-430a-474f-95ed-505f64aeb0c0 admin admin] Calling method '>' {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:53:40.308375 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-4f12772d-430a-474f-95ed-505f64aeb0c0 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 May 26 17:53:40.308899 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 13/24] 10.222.0.69 () {54 vars in 930 bytes} [Thu May 26 17:53:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:53:40.369942 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-78ffac31-b001-4e3c-8882-393a2f1a252c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.small", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 2048, "vcpus": 1}} {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:53:40.388043 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-78ffac31-b001-4e3c-8882-393a2f1a252c admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.073212 May 26 17:53:40.388595 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 12/25] 10.222.0.69 () {64 vars in 1282 bytes} [Thu May 26 17:53:40 2022] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 17:53:40.401986 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-f34170be-bc12-4ba6-aa35-1e1e2a6ee051 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:53:40.426932 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-f34170be-bc12-4ba6-aa35-1e1e2a6ee051 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028952 May 26 17:53:40.427519 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 14/26] 10.222.0.69 () {64 vars in 1332 bytes} [Thu May 26 17:53:40 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:53:42.705101 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-78ffac31-b001-4e3c-8882-393a2f1a252c admin admin] Calling method '>' {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:53:42.706119 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-78ffac31-b001-4e3c-8882-393a2f1a252c admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002554 May 26 17:53:42.706522 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 13/27] 10.222.0.69 () {54 vars in 930 bytes} [Thu May 26 17:53:42 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:53:42.767860 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-58cc2b70-a42f-48e8-bafd-70379d3ce71f admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 4096, "swap": 0, "vcpus": 2, "name": "m1.medium", "disk": 40, "os-flavor-access:is_public": true}} {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:53:42.788224 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-58cc2b70-a42f-48e8-bafd-70379d3ce71f admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.075687 May 26 17:53:42.788777 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 15/28] 10.222.0.69 () {64 vars in 1282 bytes} [Thu May 26 17:53:42 2022] POST /compute/v2.1/flavors => generated 406 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 17:53:42.810462 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-2b43ea88-7979-484d-b0ce-28adec6fac84 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:53:42.849387 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-2b43ea88-7979-484d-b0ce-28adec6fac84 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.052088 May 26 17:53:42.850228 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 14/29] 10.222.0.69 () {64 vars in 1332 bytes} [Thu May 26 17:53:42 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:53:45.164006 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-58cc2b70-a42f-48e8-bafd-70379d3ce71f admin admin] Calling method '>' {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:53:45.165048 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-58cc2b70-a42f-48e8-bafd-70379d3ce71f admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 May 26 17:53:45.165481 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 16/30] 10.222.0.69 () {54 vars in 930 bytes} [Thu May 26 17:53:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:53:45.230506 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-cea233fc-083e-42c4-959b-db073401425d admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "os-flavor-access:is_public": true, "vcpus": 4, "ram": 8192, "rxtx_factor": 1.0, "disk": 80}} {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:53:45.249625 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-cea233fc-083e-42c4-959b-db073401425d admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.078038 May 26 17:53:45.251063 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 15/31] 10.222.0.69 () {64 vars in 1282 bytes} [Thu May 26 17:53:45 2022] POST /compute/v2.1/flavors => generated 405 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 17:53:45.262870 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-2a92e219-18f3-4611-a44c-2cbde01f59e3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:53:45.287539 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-2a92e219-18f3-4611-a44c-2cbde01f59e3 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028255 May 26 17:53:45.288190 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 17/32] 10.222.0.69 () {64 vars in 1332 bytes} [Thu May 26 17:53:45 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:53:47.647944 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-cea233fc-083e-42c4-959b-db073401425d admin admin] Calling method '>' {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:53:47.649908 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-cea233fc-083e-42c4-959b-db073401425d admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002322 May 26 17:53:47.660122 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 16/33] 10.222.0.69 () {54 vars in 930 bytes} [Thu May 26 17:53:47 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:53:47.723332 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-dc4473d1-2c7c-4e9b-a859-4d818658f5cc admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "vcpus": 8, "id": "5", "os-flavor-access:is_public": true, "ram": 16384, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge"}} {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:53:47.754816 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-dc4473d1-2c7c-4e9b-a859-4d818658f5cc admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.096869 May 26 17:53:47.756084 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 18/34] 10.222.0.69 () {64 vars in 1282 bytes} [Thu May 26 17:53:47 2022] POST /compute/v2.1/flavors => generated 408 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 17:53:47.767723 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-c0ccd98d-7383-4e78-901e-97f655512d68 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:53:47.792807 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-c0ccd98d-7383-4e78-901e-97f655512d68 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028693 May 26 17:53:47.793399 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 17/35] 10.222.0.69 () {64 vars in 1332 bytes} [Thu May 26 17:53:47 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:54:14.352105 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-dc4473d1-2c7c-4e9b-a859-4d818658f5cc admin admin] Calling method '>' {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:54:14.353223 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-dc4473d1-2c7c-4e9b-a859-4d818658f5cc admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001581 May 26 17:54:14.353634 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 19/36] 10.222.0.69 () {54 vars in 930 bytes} [Thu May 26 17:54:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:54:14.365884 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG dbcounter [-] [103096] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:54:14.423475 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-d3bc02ad-9e49-4706-a0d1-b3331e0e4113 admin admin] Calling method '>' {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:54:14.441894 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-d3bc02ad-9e49-4706-a0d1-b3331e0e4113 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.080677 May 26 17:54:14.442450 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 18/37] 10.222.0.69 () {60 vars in 1291 bytes} [Thu May 26 17:54:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:54:15.558546 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-dc4473d1-2c7c-4e9b-a859-4d818658f5cc admin admin] Calling method '>' {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:54:15.559699 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-dc4473d1-2c7c-4e9b-a859-4d818658f5cc admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001569 May 26 17:54:15.560128 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 20/38] 10.222.0.69 () {56 vars in 1074 bytes} [Thu May 26 17:54:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:54:15.804830 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-2781af35-febd-4372-9976-432b2114e2bf admin admin] Calling method '>' {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:54:15.810952 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.wsgi [None req-2781af35-febd-4372-9976-432b2114e2bf admin admin] HTTP exception thrown: Flavor 42 could not be found. May 26 17:54:15.814410 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-2781af35-febd-4372-9976-432b2114e2bf admin admin] Request method failure captured: May 26 17:54:15.814410 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 26 17:54:15.814410 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: Accept: application/json May 26 17:54:15.814410 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: Accept-Encoding: gzip, deflate May 26 17:54:15.814410 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: Connection: keep-alive May 26 17:54:15.814410 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: Content-Length: 0 May 26 17:54:15.814410 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: Host: 10.222.0.69 May 26 17:54:15.814410 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: Openstack-Api-Version: compute 2.90 May 26 17:54:15.814410 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: Openstack-System-Scope: None May 26 17:54:15.814410 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: User-Agent: python-novaclient May 26 17:54:15.814410 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: X-Auth-Token: gAAAAABij77H4JZTec35o64wNmEkvUr36JxKgaUwVqoi9eIjm1jG34P019KHGrvb0r-9AuH5M_oSTDPzRqOUUEHeJEC9_mHO1RGcDEee4tkyo5m6ZSWEM6XNDnYxK84EnnK1AHhBbozy61eX0VQsmGo9Gr5Tpneko9WTMyVdZAx6wbD0neFtsyE May 26 17:54:15.814410 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: X-Domain-Id: None May 26 17:54:15.814410 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: X-Domain-Name: None May 26 17:54:15.814410 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: X-Identity-Status: Confirmed May 26 17:54:15.814410 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: X-Is-Admin-Project: True May 26 17:54:15.814410 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: X-Openstack-Nova-Api-Version: 2.90 May 26 17:54:15.814410 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: X-Project-Domain-Id: default May 26 17:54:15.814410 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: X-Project-Domain-Name: Default May 26 17:54:15.814410 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: X-Project-Id: 0ff1c526db504733a6f9bcf8c7e9e653 May 26 17:54:15.814410 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: X-Project-Name: admin May 26 17:54:15.814410 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: X-Role: admin,reader,member May 26 17:54:15.814410 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: X-Roles: admin,reader,member May 26 17:54:15.817638 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0ff1c526db504733a6f9bcf8c7e9e653"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/0ff1c526db504733a6f9bcf8c7e9e653"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0ff1c526db504733a6f9bcf8c7e9e653"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_0ff1c526db504733a6f9bcf8c7e9e653"}]}] May 26 17:54:15.817638 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: X-Tenant: admin May 26 17:54:15.817638 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: X-Tenant-Id: 0ff1c526db504733a6f9bcf8c7e9e653 May 26 17:54:15.817638 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: X-Tenant-Name: admin May 26 17:54:15.817638 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: X-User: admin May 26 17:54:15.817638 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: X-User-Domain-Id: default May 26 17:54:15.817638 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: X-User-Domain-Name: Default May 26 17:54:15.817638 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: X-User-Id: c2a69d3812404e20840e7bb0da9d4d1a May 26 17:54:15.817638 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: X-User-Name: admin May 26 17:54:15.817638 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: method: > May 26 17:54:15.817638 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: exception: Flavor 42 could not be found. May 26 17:54:15.817638 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: action_args: {'id': '42'} May 26 17:54:15.817638 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:54:15.817638 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:54:15.818969 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 17:54:15.818969 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 17:54:15.818969 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 17:54:15.818969 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 17:54:15.818969 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 17:54:15.818969 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 17:54:15.818969 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 17:54:15.818969 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 17:54:15.818969 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 17:54:15.818969 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:54:15.818969 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 17:54:15.818969 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 17:54:15.818969 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 26 17:54:15.818969 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi May 26 17:54:15.818969 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:54:15.818969 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi May 26 17:54:15.818969 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:54:15.818969 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:54:15.818969 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:54:15.820359 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:54:15.820359 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:54:15.820359 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:54:15.820359 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:54:15.820359 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 17:54:15.820359 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 17:54:15.820359 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 26 17:54:15.820359 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi May 26 17:54:15.820359 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:54:15.820359 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi May 26 17:54:15.820359 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:54:15.820359 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:54:15.820359 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:54:15.820359 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:54:15.820359 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:54:15.820359 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 26 17:54:15.820359 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi May 26 17:54:15.820359 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-2781af35-febd-4372-9976-432b2114e2bf admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103096) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:54:15.821730 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-2781af35-febd-4372-9976-432b2114e2bf admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.072202 May 26 17:54:15.821730 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 19/39] 10.222.0.69 () {60 vars in 1190 bytes} [Thu May 26 17:54:15 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 26 17:54:15.825851 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-087d7b79-c449-4b30-95b6-351e07c594a7 admin admin] Calling method '>' {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:54:15.829438 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG dbcounter [-] [103097] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:54:15.850384 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-087d7b79-c449-4b30-95b6-351e07c594a7 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028035 May 26 17:54:15.850967 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 21/40] 10.222.0.69 () {60 vars in 1210 bytes} [Thu May 26 17:54:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:54:15.862339 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-b834330e-e318-470b-aafc-d35a6e52a80f admin admin] Calling method '>' {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:54:15.887717 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-b834330e-e318-470b-aafc-d35a6e52a80f admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029680 May 26 17:54:15.888333 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 20/41] 10.222.0.69 () {60 vars in 1210 bytes} [Thu May 26 17:54:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:54:15.899857 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-bb1756b0-308f-4020-9fc3-d6a2ae3b9c1b admin admin] Calling method '>' {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:54:15.907746 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.wsgi [None req-bb1756b0-308f-4020-9fc3-d6a2ae3b9c1b admin admin] HTTP exception thrown: Flavor 42 could not be found. May 26 17:54:15.911108 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-bb1756b0-308f-4020-9fc3-d6a2ae3b9c1b admin admin] Request method failure captured: May 26 17:54:15.911108 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 26 17:54:15.911108 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: Accept: application/json May 26 17:54:15.911108 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: Accept-Encoding: gzip, deflate May 26 17:54:15.911108 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: Connection: keep-alive May 26 17:54:15.911108 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: Content-Length: 0 May 26 17:54:15.911108 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: Host: 10.222.0.69 May 26 17:54:15.911108 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: Openstack-Api-Version: compute 2.90 May 26 17:54:15.911108 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: Openstack-System-Scope: None May 26 17:54:15.911108 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: User-Agent: python-novaclient May 26 17:54:15.911108 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: X-Auth-Token: gAAAAABij77H4JZTec35o64wNmEkvUr36JxKgaUwVqoi9eIjm1jG34P019KHGrvb0r-9AuH5M_oSTDPzRqOUUEHeJEC9_mHO1RGcDEee4tkyo5m6ZSWEM6XNDnYxK84EnnK1AHhBbozy61eX0VQsmGo9Gr5Tpneko9WTMyVdZAx6wbD0neFtsyE May 26 17:54:15.911108 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: X-Domain-Id: None May 26 17:54:15.911108 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: X-Domain-Name: None May 26 17:54:15.911108 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: X-Identity-Status: Confirmed May 26 17:54:15.911108 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: X-Is-Admin-Project: True May 26 17:54:15.911108 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: X-Openstack-Nova-Api-Version: 2.90 May 26 17:54:15.911108 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: X-Project-Domain-Id: default May 26 17:54:15.911108 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: X-Project-Domain-Name: Default May 26 17:54:15.911108 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: X-Project-Id: 0ff1c526db504733a6f9bcf8c7e9e653 May 26 17:54:15.911108 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: X-Project-Name: admin May 26 17:54:15.911108 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: X-Role: admin,reader,member May 26 17:54:15.911108 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: X-Roles: admin,reader,member May 26 17:54:15.912831 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0ff1c526db504733a6f9bcf8c7e9e653"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/0ff1c526db504733a6f9bcf8c7e9e653"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0ff1c526db504733a6f9bcf8c7e9e653"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_0ff1c526db504733a6f9bcf8c7e9e653"}]}] May 26 17:54:15.912831 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: X-Tenant: admin May 26 17:54:15.912831 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: X-Tenant-Id: 0ff1c526db504733a6f9bcf8c7e9e653 May 26 17:54:15.912831 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: X-Tenant-Name: admin May 26 17:54:15.912831 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: X-User: admin May 26 17:54:15.912831 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: X-User-Domain-Id: default May 26 17:54:15.912831 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: X-User-Domain-Name: Default May 26 17:54:15.912831 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: X-User-Id: c2a69d3812404e20840e7bb0da9d4d1a May 26 17:54:15.912831 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: X-User-Name: admin May 26 17:54:15.912831 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: method: > May 26 17:54:15.912831 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: exception: Flavor 42 could not be found. May 26 17:54:15.912831 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: action_args: {'id': '42'} May 26 17:54:15.912831 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:54:15.912831 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:54:15.913973 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 17:54:15.913973 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 17:54:15.913973 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 17:54:15.913973 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 17:54:15.913973 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 17:54:15.913973 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 17:54:15.913973 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 17:54:15.913973 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 17:54:15.913973 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 17:54:15.913973 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:54:15.913973 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 17:54:15.913973 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 17:54:15.913973 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 26 17:54:15.913973 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi May 26 17:54:15.913973 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:54:15.913973 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi May 26 17:54:15.913973 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:54:15.913973 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:54:15.913973 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:54:15.915699 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:54:15.915699 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:54:15.915699 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:54:15.915699 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:54:15.915699 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 17:54:15.915699 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 17:54:15.915699 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 26 17:54:15.915699 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi May 26 17:54:15.915699 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:54:15.915699 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi May 26 17:54:15.915699 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:54:15.915699 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:54:15.915699 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:54:15.915699 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:54:15.915699 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:54:15.915699 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 26 17:54:15.915699 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi May 26 17:54:15.915699 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-bb1756b0-308f-4020-9fc3-d6a2ae3b9c1b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:54:15.917901 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-bb1756b0-308f-4020-9fc3-d6a2ae3b9c1b admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.017674 May 26 17:54:15.917901 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 22/42] 10.222.0.69 () {60 vars in 1190 bytes} [Thu May 26 17:54:15 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 17:54:16.873202 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-b834330e-e318-470b-aafc-d35a6e52a80f admin admin] Calling method '>' {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:54:16.874286 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-b834330e-e318-470b-aafc-d35a6e52a80f admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 May 26 17:54:16.874930 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 21/43] 10.222.0.69 () {56 vars in 1074 bytes} [Thu May 26 17:54:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:54:17.076760 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-dcba21e8-069b-4c7f-a110-5d266ed54573 admin admin] Calling method '>' {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:54:17.084051 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.wsgi [None req-dcba21e8-069b-4c7f-a110-5d266ed54573 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 26 17:54:17.085893 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-dcba21e8-069b-4c7f-a110-5d266ed54573 admin admin] Request method failure captured: May 26 17:54:17.085893 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 26 17:54:17.085893 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: Accept: application/json May 26 17:54:17.085893 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: Accept-Encoding: gzip, deflate May 26 17:54:17.085893 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: Connection: keep-alive May 26 17:54:17.085893 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: Content-Length: 0 May 26 17:54:17.085893 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: Host: 10.222.0.69 May 26 17:54:17.085893 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: Openstack-Api-Version: compute 2.90 May 26 17:54:17.085893 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: Openstack-System-Scope: None May 26 17:54:17.085893 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: User-Agent: python-novaclient May 26 17:54:17.085893 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: X-Auth-Token: gAAAAABij77I4Ct2pwYJ0MHl3BZsOPrKzcGGRgBH4K08-ZuuofN36QZbWrMr4FJ9GSp99aiFfpgCLsBKpocJwVTwhAB38ldu8YKtWhN5keD5wABuH1Owxsv1Q75YYO60TAtzTx_2Sd4-X1_D95ppumR7Zpsf-ZWJo2xQXA453i3Tx3dzZ6cvo9U May 26 17:54:17.085893 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: X-Domain-Id: None May 26 17:54:17.085893 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: X-Domain-Name: None May 26 17:54:17.085893 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: X-Identity-Status: Confirmed May 26 17:54:17.085893 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: X-Is-Admin-Project: True May 26 17:54:17.085893 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: X-Openstack-Nova-Api-Version: 2.90 May 26 17:54:17.085893 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: X-Project-Domain-Id: default May 26 17:54:17.085893 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: X-Project-Domain-Name: Default May 26 17:54:17.085893 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: X-Project-Id: 0ff1c526db504733a6f9bcf8c7e9e653 May 26 17:54:17.085893 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: X-Project-Name: admin May 26 17:54:17.085893 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: X-Role: admin,reader,member May 26 17:54:17.085893 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: X-Roles: admin,reader,member May 26 17:54:17.088383 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0ff1c526db504733a6f9bcf8c7e9e653"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/0ff1c526db504733a6f9bcf8c7e9e653"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0ff1c526db504733a6f9bcf8c7e9e653"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_0ff1c526db504733a6f9bcf8c7e9e653"}]}] May 26 17:54:17.088383 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: X-Tenant: admin May 26 17:54:17.088383 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: X-Tenant-Id: 0ff1c526db504733a6f9bcf8c7e9e653 May 26 17:54:17.088383 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: X-Tenant-Name: admin May 26 17:54:17.088383 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: X-User: admin May 26 17:54:17.088383 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: X-User-Domain-Id: default May 26 17:54:17.088383 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: X-User-Domain-Name: Default May 26 17:54:17.088383 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: X-User-Id: c2a69d3812404e20840e7bb0da9d4d1a May 26 17:54:17.088383 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: X-User-Name: admin May 26 17:54:17.088383 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: method: > May 26 17:54:17.088383 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: exception: Flavor 84 could not be found. May 26 17:54:17.088383 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: action_args: {'id': '84'} May 26 17:54:17.088383 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:54:17.088383 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:54:17.089596 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 17:54:17.089596 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 17:54:17.089596 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 17:54:17.089596 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 17:54:17.089596 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 17:54:17.089596 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 17:54:17.089596 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 17:54:17.089596 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 17:54:17.089596 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 17:54:17.089596 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:54:17.089596 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 17:54:17.089596 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 17:54:17.089596 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 26 17:54:17.089596 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi May 26 17:54:17.089596 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:54:17.089596 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi May 26 17:54:17.089596 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:54:17.089596 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:54:17.089596 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:54:17.091191 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:54:17.091191 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:54:17.091191 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:54:17.091191 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:54:17.091191 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 17:54:17.091191 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 17:54:17.091191 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 26 17:54:17.091191 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi May 26 17:54:17.091191 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:54:17.091191 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi May 26 17:54:17.091191 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:54:17.091191 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:54:17.091191 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:54:17.091191 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:54:17.091191 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:54:17.091191 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 26 17:54:17.091191 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi May 26 17:54:17.091191 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-dcba21e8-069b-4c7f-a110-5d266ed54573 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:54:17.092695 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-dcba21e8-069b-4c7f-a110-5d266ed54573 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.068609 May 26 17:54:17.092695 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 23/44] 10.222.0.69 () {60 vars in 1190 bytes} [Thu May 26 17:54:17 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 17:54:17.099332 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-a2bfea71-8e17-41ac-8f4e-b8585fd3a8ff admin admin] Calling method '>' {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:54:17.114059 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-a2bfea71-8e17-41ac-8f4e-b8585fd3a8ff admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018301 May 26 17:54:17.114868 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 22/45] 10.222.0.69 () {60 vars in 1210 bytes} [Thu May 26 17:54:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:54:17.127241 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-ca8b736a-a48f-4230-bb79-e692d0280702 admin admin] Calling method '>' {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:54:17.144988 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-ca8b736a-a48f-4230-bb79-e692d0280702 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.022124 May 26 17:54:17.145602 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 24/46] 10.222.0.69 () {60 vars in 1210 bytes} [Thu May 26 17:54:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:54:17.156909 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-8bf4484a-5682-4b07-8422-0e088775148a admin admin] Calling method '>' {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:54:17.163122 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.wsgi [None req-8bf4484a-5682-4b07-8422-0e088775148a admin admin] HTTP exception thrown: Flavor 84 could not be found. May 26 17:54:17.164813 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-8bf4484a-5682-4b07-8422-0e088775148a admin admin] Request method failure captured: May 26 17:54:17.164813 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 26 17:54:17.164813 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: Accept: application/json May 26 17:54:17.164813 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: Accept-Encoding: gzip, deflate May 26 17:54:17.164813 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: Connection: keep-alive May 26 17:54:17.164813 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: Content-Length: 0 May 26 17:54:17.164813 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: Host: 10.222.0.69 May 26 17:54:17.164813 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: Openstack-Api-Version: compute 2.90 May 26 17:54:17.164813 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: Openstack-System-Scope: None May 26 17:54:17.164813 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: User-Agent: python-novaclient May 26 17:54:17.164813 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: X-Auth-Token: gAAAAABij77I4Ct2pwYJ0MHl3BZsOPrKzcGGRgBH4K08-ZuuofN36QZbWrMr4FJ9GSp99aiFfpgCLsBKpocJwVTwhAB38ldu8YKtWhN5keD5wABuH1Owxsv1Q75YYO60TAtzTx_2Sd4-X1_D95ppumR7Zpsf-ZWJo2xQXA453i3Tx3dzZ6cvo9U May 26 17:54:17.164813 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: X-Domain-Id: None May 26 17:54:17.164813 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: X-Domain-Name: None May 26 17:54:17.164813 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: X-Identity-Status: Confirmed May 26 17:54:17.164813 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: X-Is-Admin-Project: True May 26 17:54:17.164813 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: X-Openstack-Nova-Api-Version: 2.90 May 26 17:54:17.164813 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: X-Project-Domain-Id: default May 26 17:54:17.164813 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: X-Project-Domain-Name: Default May 26 17:54:17.164813 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: X-Project-Id: 0ff1c526db504733a6f9bcf8c7e9e653 May 26 17:54:17.164813 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: X-Project-Name: admin May 26 17:54:17.164813 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: X-Role: admin,reader,member May 26 17:54:17.164813 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: X-Roles: admin,reader,member May 26 17:54:17.166337 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0ff1c526db504733a6f9bcf8c7e9e653"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/0ff1c526db504733a6f9bcf8c7e9e653"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0ff1c526db504733a6f9bcf8c7e9e653"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_0ff1c526db504733a6f9bcf8c7e9e653"}]}] May 26 17:54:17.166337 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: X-Tenant: admin May 26 17:54:17.166337 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: X-Tenant-Id: 0ff1c526db504733a6f9bcf8c7e9e653 May 26 17:54:17.166337 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: X-Tenant-Name: admin May 26 17:54:17.166337 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: X-User: admin May 26 17:54:17.166337 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: X-User-Domain-Id: default May 26 17:54:17.166337 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: X-User-Domain-Name: Default May 26 17:54:17.166337 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: X-User-Id: c2a69d3812404e20840e7bb0da9d4d1a May 26 17:54:17.166337 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: X-User-Name: admin May 26 17:54:17.166337 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: method: > May 26 17:54:17.166337 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: exception: Flavor 84 could not be found. May 26 17:54:17.166337 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: action_args: {'id': '84'} May 26 17:54:17.166337 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:54:17.166337 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:54:17.167269 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 17:54:17.167269 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 17:54:17.167269 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 17:54:17.167269 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 17:54:17.167269 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 17:54:17.167269 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 17:54:17.167269 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 17:54:17.167269 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 17:54:17.167269 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 17:54:17.167269 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:54:17.167269 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 17:54:17.167269 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 17:54:17.167269 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 26 17:54:17.167269 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi May 26 17:54:17.167269 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:54:17.167269 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi May 26 17:54:17.167269 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:54:17.167269 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:54:17.167269 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:54:17.168641 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:54:17.168641 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:54:17.168641 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:54:17.168641 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:54:17.168641 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 17:54:17.168641 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 17:54:17.168641 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 26 17:54:17.168641 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi May 26 17:54:17.168641 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:54:17.168641 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi May 26 17:54:17.168641 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:54:17.168641 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:54:17.168641 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:54:17.168641 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:54:17.168641 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:54:17.168641 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 26 17:54:17.168641 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi May 26 17:54:17.168641 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-8bf4484a-5682-4b07-8422-0e088775148a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103096) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:54:17.169935 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-8bf4484a-5682-4b07-8422-0e088775148a admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.014245 May 26 17:54:17.169935 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 23/47] 10.222.0.69 () {60 vars in 1190 bytes} [Thu May 26 17:54:17 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 26 17:54:18.129277 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-ca8b736a-a48f-4230-bb79-e692d0280702 admin admin] Calling method '>' {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:54:18.130286 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-ca8b736a-a48f-4230-bb79-e692d0280702 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001698 May 26 17:54:18.130684 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 25/48] 10.222.0.69 () {56 vars in 1074 bytes} [Thu May 26 17:54:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:54:18.343037 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-f1091bca-d096-479c-8e83-661de73b06fc admin admin] Calling method '>' {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:54:18.350509 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.wsgi [None req-f1091bca-d096-479c-8e83-661de73b06fc admin admin] HTTP exception thrown: Flavor 451 could not be found. May 26 17:54:18.352095 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-f1091bca-d096-479c-8e83-661de73b06fc admin admin] Request method failure captured: May 26 17:54:18.352095 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 26 17:54:18.352095 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: Accept: application/json May 26 17:54:18.352095 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: Accept-Encoding: gzip, deflate May 26 17:54:18.352095 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: Connection: keep-alive May 26 17:54:18.352095 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: Content-Length: 0 May 26 17:54:18.352095 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: Host: 10.222.0.69 May 26 17:54:18.352095 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: Openstack-Api-Version: compute 2.90 May 26 17:54:18.352095 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: Openstack-System-Scope: None May 26 17:54:18.352095 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: User-Agent: python-novaclient May 26 17:54:18.352095 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: X-Auth-Token: gAAAAABij77KNpLJdVYkS4UVPO718NaNwgt0MRrna1tnTw7pNyX2JBuzx8lDPToY7kKE1I-hvYBpQ5xXOuznK4Om1ncafjW9Sm8SeCwBsb2E2unz8AqA-9M6nfEOHeTM7E8dl588sZVsRy2K1gd2bZB9aSdXnPPQggSqHr690ZV526BsUUJGlqc May 26 17:54:18.352095 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: X-Domain-Id: None May 26 17:54:18.352095 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: X-Domain-Name: None May 26 17:54:18.352095 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: X-Identity-Status: Confirmed May 26 17:54:18.352095 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: X-Is-Admin-Project: True May 26 17:54:18.352095 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: X-Openstack-Nova-Api-Version: 2.90 May 26 17:54:18.352095 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: X-Project-Domain-Id: default May 26 17:54:18.352095 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: X-Project-Domain-Name: Default May 26 17:54:18.352095 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: X-Project-Id: 0ff1c526db504733a6f9bcf8c7e9e653 May 26 17:54:18.352095 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: X-Project-Name: admin May 26 17:54:18.352095 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: X-Role: admin,reader,member May 26 17:54:18.352095 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: X-Roles: admin,reader,member May 26 17:54:18.353824 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0ff1c526db504733a6f9bcf8c7e9e653"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/0ff1c526db504733a6f9bcf8c7e9e653"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0ff1c526db504733a6f9bcf8c7e9e653"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_0ff1c526db504733a6f9bcf8c7e9e653"}]}] May 26 17:54:18.353824 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: X-Tenant: admin May 26 17:54:18.353824 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: X-Tenant-Id: 0ff1c526db504733a6f9bcf8c7e9e653 May 26 17:54:18.353824 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: X-Tenant-Name: admin May 26 17:54:18.353824 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: X-User: admin May 26 17:54:18.353824 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: X-User-Domain-Id: default May 26 17:54:18.353824 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: X-User-Domain-Name: Default May 26 17:54:18.353824 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: X-User-Id: c2a69d3812404e20840e7bb0da9d4d1a May 26 17:54:18.353824 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: X-User-Name: admin May 26 17:54:18.353824 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: method: > May 26 17:54:18.353824 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: exception: Flavor 451 could not be found. May 26 17:54:18.353824 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: action_args: {'id': '451'} May 26 17:54:18.353824 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:54:18.353824 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:54:18.354678 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 17:54:18.354678 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 17:54:18.354678 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 17:54:18.354678 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 17:54:18.354678 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 17:54:18.354678 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 17:54:18.354678 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 17:54:18.354678 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 17:54:18.354678 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 17:54:18.354678 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:54:18.354678 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 17:54:18.354678 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 17:54:18.354678 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 26 17:54:18.354678 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi May 26 17:54:18.354678 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:54:18.354678 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi May 26 17:54:18.354678 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:54:18.354678 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:54:18.354678 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:54:18.355772 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:54:18.355772 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:54:18.355772 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:54:18.355772 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:54:18.355772 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 17:54:18.355772 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 17:54:18.355772 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 26 17:54:18.355772 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi May 26 17:54:18.355772 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:54:18.355772 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi May 26 17:54:18.355772 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:54:18.355772 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:54:18.355772 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:54:18.355772 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:54:18.355772 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:54:18.355772 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 26 17:54:18.355772 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: ERROR nova.api.openstack.wsgi May 26 17:54:18.355772 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-f1091bca-d096-479c-8e83-661de73b06fc admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103096) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:54:18.357127 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-f1091bca-d096-479c-8e83-661de73b06fc admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.070955 May 26 17:54:18.357127 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 24/49] 10.222.0.69 () {60 vars in 1193 bytes} [Thu May 26 17:54:18 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 26 17:54:18.365890 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-0ba96bc8-6946-46ee-a0ba-0d048bf787d7 admin admin] Calling method '>' {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:54:18.381752 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-0ba96bc8-6946-46ee-a0ba-0d048bf787d7 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020599 May 26 17:54:18.382341 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 26/50] 10.222.0.69 () {60 vars in 1210 bytes} [Thu May 26 17:54:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:54:18.394058 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-06787171-78c6-4d90-9306-a30b72452435 admin admin] Calling method '>' {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:54:18.409234 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-06787171-78c6-4d90-9306-a30b72452435 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019763 May 26 17:54:18.409801 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 25/51] 10.222.0.69 () {60 vars in 1210 bytes} [Thu May 26 17:54:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:54:18.419653 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-b68c1dc8-776d-4526-9f66-d2a80dbd0e1b admin admin] Calling method '>' {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:54:18.425800 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.wsgi [None req-b68c1dc8-776d-4526-9f66-d2a80dbd0e1b admin admin] HTTP exception thrown: Flavor 451 could not be found. May 26 17:54:18.427368 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-b68c1dc8-776d-4526-9f66-d2a80dbd0e1b admin admin] Request method failure captured: May 26 17:54:18.427368 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 26 17:54:18.427368 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: Accept: application/json May 26 17:54:18.427368 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: Accept-Encoding: gzip, deflate May 26 17:54:18.427368 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: Connection: keep-alive May 26 17:54:18.427368 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: Content-Length: 0 May 26 17:54:18.427368 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: Host: 10.222.0.69 May 26 17:54:18.427368 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: Openstack-Api-Version: compute 2.90 May 26 17:54:18.427368 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: Openstack-System-Scope: None May 26 17:54:18.427368 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: User-Agent: python-novaclient May 26 17:54:18.427368 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: X-Auth-Token: gAAAAABij77KNpLJdVYkS4UVPO718NaNwgt0MRrna1tnTw7pNyX2JBuzx8lDPToY7kKE1I-hvYBpQ5xXOuznK4Om1ncafjW9Sm8SeCwBsb2E2unz8AqA-9M6nfEOHeTM7E8dl588sZVsRy2K1gd2bZB9aSdXnPPQggSqHr690ZV526BsUUJGlqc May 26 17:54:18.427368 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: X-Domain-Id: None May 26 17:54:18.427368 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: X-Domain-Name: None May 26 17:54:18.427368 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: X-Identity-Status: Confirmed May 26 17:54:18.427368 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: X-Is-Admin-Project: True May 26 17:54:18.427368 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: X-Openstack-Nova-Api-Version: 2.90 May 26 17:54:18.427368 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: X-Project-Domain-Id: default May 26 17:54:18.427368 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: X-Project-Domain-Name: Default May 26 17:54:18.427368 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: X-Project-Id: 0ff1c526db504733a6f9bcf8c7e9e653 May 26 17:54:18.427368 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: X-Project-Name: admin May 26 17:54:18.427368 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: X-Role: admin,reader,member May 26 17:54:18.427368 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: X-Roles: admin,reader,member May 26 17:54:18.429204 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0ff1c526db504733a6f9bcf8c7e9e653"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/0ff1c526db504733a6f9bcf8c7e9e653"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/0ff1c526db504733a6f9bcf8c7e9e653"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_0ff1c526db504733a6f9bcf8c7e9e653"}]}] May 26 17:54:18.429204 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: X-Tenant: admin May 26 17:54:18.429204 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: X-Tenant-Id: 0ff1c526db504733a6f9bcf8c7e9e653 May 26 17:54:18.429204 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: X-Tenant-Name: admin May 26 17:54:18.429204 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: X-User: admin May 26 17:54:18.429204 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: X-User-Domain-Id: default May 26 17:54:18.429204 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: X-User-Domain-Name: Default May 26 17:54:18.429204 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: X-User-Id: c2a69d3812404e20840e7bb0da9d4d1a May 26 17:54:18.429204 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: X-User-Name: admin May 26 17:54:18.429204 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: method: > May 26 17:54:18.429204 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: exception: Flavor 451 could not be found. May 26 17:54:18.429204 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: action_args: {'id': '451'} May 26 17:54:18.429204 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:54:18.429204 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:54:18.430089 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 17:54:18.430089 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 17:54:18.430089 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 17:54:18.430089 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 17:54:18.430089 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 17:54:18.430089 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 17:54:18.430089 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 17:54:18.430089 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 17:54:18.430089 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 17:54:18.430089 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:54:18.430089 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 17:54:18.430089 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 17:54:18.430089 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 26 17:54:18.430089 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi May 26 17:54:18.430089 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:54:18.430089 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi May 26 17:54:18.430089 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:54:18.430089 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:54:18.430089 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:54:18.431153 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:54:18.431153 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:54:18.431153 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:54:18.431153 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:54:18.431153 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 17:54:18.431153 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 17:54:18.431153 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 26 17:54:18.431153 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi May 26 17:54:18.431153 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:54:18.431153 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi May 26 17:54:18.431153 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:54:18.431153 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:54:18.431153 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:54:18.431153 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:54:18.431153 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:54:18.431153 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 26 17:54:18.431153 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: ERROR nova.api.openstack.wsgi May 26 17:54:18.431153 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-b68c1dc8-776d-4526-9f66-d2a80dbd0e1b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:54:18.432302 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-b68c1dc8-776d-4526-9f66-d2a80dbd0e1b admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012919 May 26 17:54:18.432302 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 27/52] 10.222.0.69 () {60 vars in 1193 bytes} [Thu May 26 17:54:18 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 26 17:54:19.355453 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-06787171-78c6-4d90-9306-a30b72452435 admin admin] Calling method '>' {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:54:19.356520 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-06787171-78c6-4d90-9306-a30b72452435 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 May 26 17:54:19.356926 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 26/53] 10.222.0.69 () {56 vars in 1074 bytes} [Thu May 26 17:54:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:54:19.563186 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-8ec1d52f-099a-46c1-826a-67f0178b20ef admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:54:19.583025 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-8ec1d52f-099a-46c1-826a-67f0178b20ef admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.078117 May 26 17:54:19.583581 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 28/54] 10.222.0.69 () {64 vars in 1235 bytes} [Thu May 26 17:54:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 17:54:20.501041 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-06787171-78c6-4d90-9306-a30b72452435 admin admin] Calling method '>' {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:54:20.502055 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-06787171-78c6-4d90-9306-a30b72452435 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 May 26 17:54:20.502461 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 27/55] 10.222.0.69 () {56 vars in 1074 bytes} [Thu May 26 17:54:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:54:20.701902 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-a4deae05-360f-4f13-8253-cd39e40bf2de admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:54:20.720778 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-a4deae05-360f-4f13-8253-cd39e40bf2de admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.079567 May 26 17:54:20.721294 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 29/56] 10.222.0.69 () {64 vars in 1235 bytes} [Thu May 26 17:54:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 17:54:21.629871 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-06787171-78c6-4d90-9306-a30b72452435 admin admin] Calling method '>' {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:54:21.630912 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-06787171-78c6-4d90-9306-a30b72452435 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 May 26 17:54:21.631313 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 28/57] 10.222.0.69 () {56 vars in 1074 bytes} [Thu May 26 17:54:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:54:21.852419 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-fc0bbb44-ef03-4ce7-9f92-7a44806b7f91 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:54:21.875939 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-fc0bbb44-ef03-4ce7-9f92-7a44806b7f91 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.088891 May 26 17:54:21.876815 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 30/58] 10.222.0.69 () {64 vars in 1235 bytes} [Thu May 26 17:54:21 2022] POST /compute/v2.1/flavors => generated 407 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 17:54:22.855143 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-06787171-78c6-4d90-9306-a30b72452435 admin admin] Calling method '>' {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:54:22.856473 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-06787171-78c6-4d90-9306-a30b72452435 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001752 May 26 17:54:22.857195 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 29/59] 10.222.0.69 () {56 vars in 1074 bytes} [Thu May 26 17:54:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:54:23.072935 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-2c75a857-05ab-42c1-8f83-8aa40808ccd5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:54:23.092532 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-2c75a857-05ab-42c1-8f83-8aa40808ccd5 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.081306 May 26 17:54:23.093089 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 31/60] 10.222.0.69 () {64 vars in 1235 bytes} [Thu May 26 17:54:23 2022] POST /compute/v2.1/flavors => generated 409 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 17:54:24.019702 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-06787171-78c6-4d90-9306-a30b72452435 admin admin] Calling method '>' {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:54:24.021023 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-06787171-78c6-4d90-9306-a30b72452435 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001926 May 26 17:54:24.021552 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 30/61] 10.222.0.69 () {56 vars in 1074 bytes} [Thu May 26 17:54:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:54:24.240668 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-02a7ee9e-6ba9-4ed8-98c6-d68a954cdc95 admin admin] Calling method '>' {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:54:24.268508 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-02a7ee9e-6ba9-4ed8-98c6-d68a954cdc95 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.086722 May 26 17:54:24.269049 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 32/62] 10.222.0.69 () {60 vars in 1202 bytes} [Thu May 26 17:54:24 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:55:28.512228 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-06787171-78c6-4d90-9306-a30b72452435 admin admin] Calling method '>' {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:55:28.513261 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-06787171-78c6-4d90-9306-a30b72452435 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 May 26 17:55:28.513663 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 31/63] 10.222.0.69 () {54 vars in 930 bytes} [Thu May 26 17:55:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:55:28.521513 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG dbcounter [-] [103097] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:55:28.575306 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-d16ede58-a754-4d01-95dc-547cb195d7dd admin admin] Calling method '>' {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:55:28.594977 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-d16ede58-a754-4d01-95dc-547cb195d7dd admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.075025 May 26 17:55:28.595525 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 33/64] 10.222.0.69 () {60 vars in 1291 bytes} [Thu May 26 17:55:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 17:55:28.617481 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG dbcounter [-] [103096] Writing DB stats nova_api:SELECT=14 {{(pid=103096) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:55:28.622411 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-64a5a04d-6f0c-4d2d-9e88-fd30f4a4147b admin admin] Calling method '>' {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:55:28.630442 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-64a5a04d-6f0c-4d2d-9e88-fd30f4a4147b admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014491 May 26 17:55:28.630990 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 32/65] 10.222.0.69 () {60 vars in 1282 bytes} [Thu May 26 17:55:28 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:55:28.643817 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-235da4cd-396a-41c1-a71c-caa886e1eec4 admin admin] Calling method '>' {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:55:28.651633 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-235da4cd-396a-41c1-a71c-caa886e1eec4 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011562 May 26 17:55:28.652201 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 34/66] 10.222.0.69 () {60 vars in 1285 bytes} [Thu May 26 17:55:28 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:55:28.664325 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-e6cc925f-ebe9-4821-8b80-fa6954eaec03 admin admin] Calling method '>' {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:55:28.673262 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-e6cc925f-ebe9-4821-8b80-fa6954eaec03 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012517 May 26 17:55:28.673802 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 33/67] 10.222.0.69 () {60 vars in 1285 bytes} [Thu May 26 17:55:28 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:55:28.687447 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-3cc69f41-1784-488f-ab95-be62b96ab966 admin admin] Calling method '>' {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:55:28.694964 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-3cc69f41-1784-488f-ab95-be62b96ab966 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011147 May 26 17:55:28.695705 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 35/68] 10.222.0.69 () {60 vars in 1282 bytes} [Thu May 26 17:55:28 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:59:08.631986 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-e6cc925f-ebe9-4821-8b80-fa6954eaec03 admin admin] Calling method '>' {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:59:08.633246 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-e6cc925f-ebe9-4821-8b80-fa6954eaec03 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002484 May 26 17:59:08.633734 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 34/69] 10.222.0.69 () {56 vars in 1074 bytes} [Thu May 26 17:59:08 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:59:08.804129 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG dbcounter [-] [103097] Writing DB stats nova_api:SELECT=6 {{(pid=103097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:59:08.936701 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-db24f574-8f5c-43a6-984d-f0c3bc2a32e2 admin admin] Calling method '>' {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:59:08.937973 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 17:59:08.937973 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: warnings.warn(msg) May 26 17:59:08.939213 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG oslo_concurrency.lockutils [None req-db24f574-8f5c-43a6-984d-f0c3bc2a32e2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:59:08.939654 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG oslo_concurrency.lockutils [None req-db24f574-8f5c-43a6-984d-f0c3bc2a32e2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:59:08.940477 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG oslo_concurrency.lockutils [None req-db24f574-8f5c-43a6-984d-f0c3bc2a32e2 admin admin] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:59:08.940903 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG oslo_concurrency.lockutils [None req-db24f574-8f5c-43a6-984d-f0c3bc2a32e2 admin admin] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:59:08.982299 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-db24f574-8f5c-43a6-984d-f0c3bc2a32e2 admin admin] 10.222.0.69 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.179232 May 26 17:59:08.983344 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 36/70] 10.222.0.69 () {60 vars in 1193 bytes} [Thu May 26 17:59:08 2022] GET /compute/v2.1/os-services => generated 791 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 17:59:09.921536 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-e6cc925f-ebe9-4821-8b80-fa6954eaec03 admin admin] Calling method '>' {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:59:09.922545 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-e6cc925f-ebe9-4821-8b80-fa6954eaec03 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 May 26 17:59:09.922956 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 35/71] 10.222.0.69 () {56 vars in 1074 bytes} [Thu May 26 17:59:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 17:59:10.123917 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-ac3517b5-6372-4387-b6fc-ec8695da25f1 admin admin] Calling method '>' {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:59:10.125151 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 17:59:10.125151 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: warnings.warn(msg) May 26 17:59:10.126373 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG oslo_concurrency.lockutils [None req-ac3517b5-6372-4387-b6fc-ec8695da25f1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:59:10.126853 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG oslo_concurrency.lockutils [None req-ac3517b5-6372-4387-b6fc-ec8695da25f1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:59:10.127654 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG oslo_concurrency.lockutils [None req-ac3517b5-6372-4387-b6fc-ec8695da25f1 admin admin] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:59:10.128105 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG oslo_concurrency.lockutils [None req-ac3517b5-6372-4387-b6fc-ec8695da25f1 admin admin] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:59:10.150460 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-ac3517b5-6372-4387-b6fc-ec8695da25f1 admin admin] 10.222.0.69 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.082727 May 26 17:59:10.151043 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 37/72] 10.222.0.69 () {60 vars in 1193 bytes} [Thu May 26 17:59:10 2022] GET /compute/v2.1/os-services => generated 791 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 17:59:21.467057 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-e6cc925f-ebe9-4821-8b80-fa6954eaec03 admin admin] Calling method '>' {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:59:21.468091 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-e6cc925f-ebe9-4821-8b80-fa6954eaec03 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 May 26 17:59:21.468772 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 36/73] 10.222.0.69 () {56 vars in 1074 bytes} [Thu May 26 17:59:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:59:21.624911 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG dbcounter [-] [103097] Writing DB stats nova_cell0:SELECT=4 {{(pid=103097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:59:21.625634 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG dbcounter [-] [103097] Writing DB stats nova_cell1:SELECT=4 {{(pid=103097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:59:21.626756 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG dbcounter [-] [103097] Writing DB stats nova_api:SELECT=8 {{(pid=103097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:59:21.675543 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-f2076d82-f0dd-4a68-8c2e-ed5545c2ce60 admin admin] Calling method '>' {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:59:21.676710 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 17:59:21.676710 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: warnings.warn(msg) May 26 17:59:21.677924 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG oslo_concurrency.lockutils [None req-f2076d82-f0dd-4a68-8c2e-ed5545c2ce60 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:59:21.678376 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG oslo_concurrency.lockutils [None req-f2076d82-f0dd-4a68-8c2e-ed5545c2ce60 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:59:21.679167 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG oslo_concurrency.lockutils [None req-f2076d82-f0dd-4a68-8c2e-ed5545c2ce60 admin admin] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:59:21.679600 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG oslo_concurrency.lockutils [None req-f2076d82-f0dd-4a68-8c2e-ed5545c2ce60 admin admin] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:59:21.707997 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-f2076d82-f0dd-4a68-8c2e-ed5545c2ce60 admin admin] 10.222.0.69 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.088320 May 26 17:59:21.708597 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 38/74] 10.222.0.69 () {60 vars in 1193 bytes} [Thu May 26 17:59:21 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:59:22.601825 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: DEBUG nova.api.openstack.wsgi [None req-e6cc925f-ebe9-4821-8b80-fa6954eaec03 admin admin] Calling method '>' {{(pid=103096) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:59:22.602821 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: INFO nova.api.openstack.requestlog [None req-e6cc925f-ebe9-4821-8b80-fa6954eaec03 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 May 26 17:59:22.603221 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: [pid: 103096|app: 0|req: 37/75] 10.222.0.69 () {56 vars in 1074 bytes} [Thu May 26 17:59:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:59:22.795982 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG nova.api.openstack.wsgi [None req-a988f91a-4eb7-4fde-a17e-28648432507a admin admin] Calling method '>' {{(pid=103097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:59:22.797246 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 17:59:22.797246 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: warnings.warn(msg) May 26 17:59:22.798499 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG oslo_concurrency.lockutils [None req-a988f91a-4eb7-4fde-a17e-28648432507a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:59:22.799027 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG oslo_concurrency.lockutils [None req-a988f91a-4eb7-4fde-a17e-28648432507a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:59:22.799809 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG oslo_concurrency.lockutils [None req-a988f91a-4eb7-4fde-a17e-28648432507a admin admin] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:59:22.800469 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: DEBUG oslo_concurrency.lockutils [None req-a988f91a-4eb7-4fde-a17e-28648432507a admin admin] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:59:22.823997 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: INFO nova.api.openstack.requestlog [None req-a988f91a-4eb7-4fde-a17e-28648432507a admin admin] 10.222.0.69 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.081377 May 26 17:59:22.824625 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: [pid: 103097|app: 0|req: 39/76] 10.222.0.69 () {60 vars in 1193 bytes} [Thu May 26 17:59:22 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:00:21.077615 dv-cinder-836074-5-iscsi devstack@n-api.service[103095]: Thu May 26 18:00:21 2022 - graceful shutdown triggered... May 26 18:00:21.077860 dv-cinder-836074-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 26 18:00:21.078610 dv-cinder-836074-5-iscsi devstack@n-api.service[103096]: Gracefully killing worker 1 (pid: 103096)... May 26 18:00:21.078989 dv-cinder-836074-5-iscsi devstack@n-api.service[103097]: Gracefully killing worker 2 (pid: 103097)... May 26 18:00:22.078678 dv-cinder-836074-5-iscsi devstack@n-api.service[103095]: worker 1 buried after 1 seconds May 26 18:00:22.078678 dv-cinder-836074-5-iscsi devstack@n-api.service[103095]: worker 2 buried after 1 seconds May 26 18:00:22.078678 dv-cinder-836074-5-iscsi devstack@n-api.service[103095]: goodbye to uWSGI. May 26 18:00:22.080207 dv-cinder-836074-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 26 18:00:22.080771 dv-cinder-836074-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 26 18:00:22.083524 dv-cinder-836074-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 26 18:00:22.100053 dv-cinder-836074-5-iscsi devstack@n-api.service[117711]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 26 18:00:22.114396 dv-cinder-836074-5-iscsi devstack@n-api.service[117711]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 26 18:00:22 2022] *** May 26 18:00:22.114396 dv-cinder-836074-5-iscsi devstack@n-api.service[117711]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 26 18:00:22.114396 dv-cinder-836074-5-iscsi devstack@n-api.service[117711]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 26 18:00:22.114396 dv-cinder-836074-5-iscsi devstack@n-api.service[117711]: nodename: dv-cinder-836074-5-iscsi May 26 18:00:22.114396 dv-cinder-836074-5-iscsi devstack@n-api.service[117711]: machine: x86_64 May 26 18:00:22.114396 dv-cinder-836074-5-iscsi devstack@n-api.service[117711]: clock source: unix May 26 18:00:22.114396 dv-cinder-836074-5-iscsi devstack@n-api.service[117711]: pcre jit disabled May 26 18:00:22.114396 dv-cinder-836074-5-iscsi devstack@n-api.service[117711]: detected number of CPU cores: 4 May 26 18:00:22.114396 dv-cinder-836074-5-iscsi devstack@n-api.service[117711]: current working directory: / May 26 18:00:22.114396 dv-cinder-836074-5-iscsi devstack@n-api.service[117711]: detected binary path: /usr/bin/uwsgi-core May 26 18:00:22.114396 dv-cinder-836074-5-iscsi devstack@n-api.service[117711]: your processes number limit is 47680 May 26 18:00:22.114396 dv-cinder-836074-5-iscsi devstack@n-api.service[117711]: your memory page size is 4096 bytes May 26 18:00:22.114396 dv-cinder-836074-5-iscsi devstack@n-api.service[117711]: detected max file descriptor number: 2048 May 26 18:00:22.114396 dv-cinder-836074-5-iscsi devstack@n-api.service[117711]: lock engine: pthread robust mutexes May 26 18:00:22.115728 dv-cinder-836074-5-iscsi devstack@n-api.service[117711]: thunder lock: enabled May 26 18:00:22.115728 dv-cinder-836074-5-iscsi devstack@n-api.service[117711]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 26 18:00:22.115728 dv-cinder-836074-5-iscsi devstack@n-api.service[117711]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 26 18:00:22.161878 dv-cinder-836074-5-iscsi devstack@n-api.service[117711]: Python main interpreter initialized at 0x55e5f895a9c0 May 26 18:00:22.161878 dv-cinder-836074-5-iscsi devstack@n-api.service[117711]: python threads support enabled May 26 18:00:22.161878 dv-cinder-836074-5-iscsi devstack@n-api.service[117711]: your server socket listen backlog is limited to 100 connections May 26 18:00:22.161878 dv-cinder-836074-5-iscsi devstack@n-api.service[117711]: your mercy for graceful operations on workers is 90 seconds May 26 18:00:22.162396 dv-cinder-836074-5-iscsi devstack@n-api.service[117711]: mapped 403077 bytes (393 KB) for 2 cores May 26 18:00:22.162396 dv-cinder-836074-5-iscsi devstack@n-api.service[117711]: *** Operational MODE: preforking *** May 26 18:00:22.162607 dv-cinder-836074-5-iscsi devstack@n-api.service[117711]: *** uWSGI is running in multiple interpreter mode *** May 26 18:00:22.162607 dv-cinder-836074-5-iscsi devstack@n-api.service[117711]: spawned uWSGI master process (pid: 117711) May 26 18:00:22.162820 dv-cinder-836074-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 26 18:00:22.164078 dv-cinder-836074-5-iscsi devstack@n-api.service[117711]: spawned uWSGI worker 1 (pid: 117722, cores: 1) May 26 18:00:22.164078 dv-cinder-836074-5-iscsi devstack@n-api.service[117711]: spawned uWSGI worker 2 (pid: 117723, cores: 1) May 26 18:00:22.164078 dv-cinder-836074-5-iscsi devstack@n-api.service[117711]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 26 18:00:23.374605 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 18:00:23.415708 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 18:00:24.193909 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 18:00:24.193909 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: from cryptography.utils import int_from_bytes May 26 18:00:24.194232 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 18:00:24.194232 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: from cryptography.utils import int_from_bytes May 26 18:00:24.250410 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 18:00:24.250410 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: from cryptography.utils import int_from_bytes May 26 18:00:24.250783 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 18:00:24.250783 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: from cryptography.utils import int_from_bytes May 26 18:00:26.671458 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 18:00:26.672073 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 18:00:26.672286 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 18:00:26.672652 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 18:00:26.672911 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 18:00:26.673307 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.673640 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.673969 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.674331 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.674635 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.674948 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.675275 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.675602 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.675932 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.676232 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.676555 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.676885 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836074-5-iscsi {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.677213 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.677522 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.677840 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.678167 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.678480 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.678807 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.679134 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.679663 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.680150 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.680469 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.680785 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.681136 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.681455 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.681779 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.682113 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.682427 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.682762 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.683093 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.683486 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836074-5-iscsi {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.683811 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.684159 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.684483 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.684913 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.685230 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.685546 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.685873 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.686199 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.686514 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.686849 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.687175 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.687501 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.687825 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.688160 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.688478 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.688795 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.689120 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.689438 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.689745 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.690003 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.690320 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.690644 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.690968 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.691300 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.691562 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.691819 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.692168 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.692505 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.692825 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.693139 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.693453 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.693766 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.694312 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.694479 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.694687 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.695549 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.695878 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.696225 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.696558 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.696872 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.697196 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.697611 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.69 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.698146 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.69 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.698389 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.698551 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.698823 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.699137 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.699547 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.699954 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.700162 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.700420 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.700735 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.701060 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.701390 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.701710 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.701966 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.702276 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.702585 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.702917 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.703288 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.703545 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.703854 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.704185 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.704497 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.704807 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.705119 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.705528 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.705740 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.706050 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.706360 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.706671 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.706980 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.707306 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.707632 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.707943 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.708282 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.708593 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.708903 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.709227 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.709541 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.709853 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.710213 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.710513 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.711346 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.711671 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.711985 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.712325 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.712650 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.712964 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.713278 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.713603 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.713923 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.714232 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.714539 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.714974 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.715146 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.715457 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.715766 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.716097 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.716404 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.716732 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.717058 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.717374 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.717688 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.717999 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.718325 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.718671 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.719011 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.719360 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.719681 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.720039 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.720370 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.720694 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.721014 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.721335 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.721668 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.721992 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.722308 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.722633 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.722959 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.723284 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.723631 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.724198 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.724349 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.724622 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.724940 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.725264 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.725597 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.725925 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.726279 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.726625 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.726977 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.727324 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.727655 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.728053 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.728336 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.728680 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.728969 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.729298 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.729638 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.729958 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.730285 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.730605 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.730926 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.731241 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.731558 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.731875 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.732247 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.732567 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.732887 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.733210 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.733532 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.733849 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.734166 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.734484 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.734796 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.735108 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.735421 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.735735 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.736068 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.736397 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.736732 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.737097 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.737523 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.737921 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.738245 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.738562 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.738878 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.739189 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.739923 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.739923 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.740254 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.740435 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.740731 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.741036 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.741365 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.741678 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.742615 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.742938 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.743350 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.743677 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.743996 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.744398 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.744678 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.745000 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.745319 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.745663 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.745999 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.746312 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.746643 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.746975 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.747298 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.747665 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.748211 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.748591 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.748591 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.748896 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.749138 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.749448 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.749760 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.750071 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.750445 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.750798 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.751010 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.751326 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.751634 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.751941 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.752277 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.752624 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.752935 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.753286 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.753633 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.753946 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.754273 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.754589 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.754912 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.755231 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.755548 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.755865 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.756219 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.756551 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.756868 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.757193 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.758222 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.758744 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.759003 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.759334 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.759647 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.759975 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.760355 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.760700 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.761024 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.761352 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.761670 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.761986 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.762308 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.762625 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.762943 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.763261 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.763591 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.763910 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.764255 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.764573 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.764901 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.765218 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.765543 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.765853 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.766173 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.766508 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.766845 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.767162 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.767478 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.767804 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.768145 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.768464 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.768781 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.769094 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.769407 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.769722 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.770044 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.770361 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.770678 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.770989 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.771311 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.771626 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.771938 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.772339 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.772591 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.772919 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.773287 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.773623 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.774137 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.774455 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.774768 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.775098 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.775415 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.775725 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.776115 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.776457 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.776810 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.777131 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.777443 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.777768 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.778139 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.778457 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.778783 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.779102 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.779421 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.779752 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.780093 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.780413 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.780733 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.781050 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.781367 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.781684 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.782017 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.782356 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.782674 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.782995 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.783306 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.783630 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.783955 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.784576 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.784917 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.785240 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.785568 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.785892 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.786218 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.786551 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.786916 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.787260 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.787574 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.787892 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.788258 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.788571 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.788992 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.789388 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.789766 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.790080 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.790396 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.790706 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.791017 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.791328 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.791638 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.791960 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.792298 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.792616 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.793125 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.793276 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.793588 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.793906 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.794215 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.794532 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.794873 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.795187 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.795529 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.795862 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.796240 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.796547 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.796858 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.797187 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.797495 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.797805 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.798111 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.798426 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.798740 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.799048 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.799369 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.799626 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 18:00:26.800155 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.800248 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 18:00:26.800331 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.800331 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.800492 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 18:00:26.800600 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.800809 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 18:00:26.800910 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.801075 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 18:00:26.801250 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.801471 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.801620 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.801806 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.801964 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.802114 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.802261 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.802401 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.802551 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.802700 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.802841 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.802980 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.803139 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.803428 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.803586 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.803727 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.803884 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.804147 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.804831 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.804990 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.805143 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.805143 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.805436 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.805584 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836074-5-iscsi {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.805734 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.805912 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.806063 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.806213 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.806390 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.806535 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.806700 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.806855 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.807004 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.807151 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.807308 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.808095 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.808252 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.808413 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.808565 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.808707 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.808867 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.809033 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.809194 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.809344 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.809485 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.809626 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.809765 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.809914 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.810069 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.810218 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.810366 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.810515 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.810655 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.810655 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.810962 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.811108 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.811262 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.811410 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.811551 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.811711 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.811857 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.811999 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.812218 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836074-5-iscsi {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.812363 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.812515 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.812655 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.812806 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.812953 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.813095 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.813242 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.813547 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.813692 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.813841 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.813996 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.814163 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.814407 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.814571 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.814729 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.814871 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.815029 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.815180 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.815338 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.815338 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.815623 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.815623 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.815890 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.815890 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.816205 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.816205 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.816480 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.816629 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.816777 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.816929 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.817079 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.817222 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.817372 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.817520 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.817668 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.817808 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.817957 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.818106 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.818255 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.818396 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.818542 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.818707 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.818849 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.819003 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.819144 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.819293 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.819442 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.819661 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.819822 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.820535 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.820701 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.821009 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.821165 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.821331 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.821483 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.821632 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.821789 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.821940 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.822090 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.822238 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.822386 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.822528 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.822675 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.822817 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.822966 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.823106 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.823264 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.823424 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.823709 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.823852 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.824002 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.824188 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.824329 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.824581 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.824731 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.824871 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.825025 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.825167 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.825309 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.825468 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.825609 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.825758 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.825899 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.826038 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.69 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.826185 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.826333 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.69 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.826474 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.826622 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.826763 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.826903 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.827049 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.827199 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.827339 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.827488 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.827628 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.827770 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.827908 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.828076 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.828248 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.828407 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.828549 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.828696 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.828846 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.828987 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.829145 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.829293 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.829442 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.829590 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.829731 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.829887 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.829887 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.830167 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.830315 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.830462 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.830602 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.830741 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.830890 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.831053 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.831202 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.831349 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.831490 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.831629 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.831790 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.831944 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.832211 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.832364 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.832506 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.832655 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.832797 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.832959 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.833137 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.833278 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.833427 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.833720 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.833879 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.834023 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.834164 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.834305 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.834451 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.834622 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.834852 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.835000 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.835162 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.835311 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.835500 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.835660 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.835812 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.835953 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.836132 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.836318 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.836473 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.836631 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.836772 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.836920 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.837075 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.837075 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.837355 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.837355 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.837629 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.837778 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.837919 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.837919 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.838194 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.838343 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.838490 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.838640 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.838780 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.838930 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.839087 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.839230 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.839370 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.839518 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.839669 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.839810 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.839998 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.840214 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.840357 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.840511 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.840652 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.840791 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.840948 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.841092 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.841253 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.841394 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.841540 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.841681 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.841830 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.842047 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.842202 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.842354 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.842505 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.842655 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.842796 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.842945 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.843094 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.843235 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.843375 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.843524 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.843524 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.843938 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.844127 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.844273 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.844413 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.844554 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.844694 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.844861 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.845107 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.845263 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.845414 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:00:26.845565 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.845713 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.845863 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.846004 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.846167 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.846167 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.846489 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.846638 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.846788 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.846937 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.847098 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.847241 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.847382 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.847532 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.847682 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.847823 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.847964 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.848154 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.848277 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.848389 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.848487 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.848582 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.848669 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.848761 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.848854 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.848954 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.849047 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.849141 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.849233 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.849319 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.849412 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.849504 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.849596 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.849682 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.849853 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.849957 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.850176 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.850279 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.850503 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.850598 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.850820 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.850915 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.851177 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.851285 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.851502 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.851624 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.851862 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.851969 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.852197 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.852294 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.852524 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.852617 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.852859 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.852965 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.853188 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.853287 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.853504 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.853616 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.853836 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.853935 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.854155 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.854258 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.854473 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.854573 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.854791 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.854893 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.855119 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.855214 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.855453 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.855571 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.855740 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.855918 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.856100 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.856272 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.856415 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.856569 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.856730 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.856874 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.857025 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.857174 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.857315 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.857463 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.857617 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.857766 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.857915 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.858056 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.858207 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.858348 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.858514 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.858657 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.858804 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.858952 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.859101 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.859244 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.859463 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.859679 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.859856 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.860008 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.860226 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.860226 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.860553 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.860774 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.860924 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.861104 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.861253 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.861408 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.861550 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.861720 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.861870 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.862078 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.862265 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.862467 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.862638 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.863083 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.863234 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.863424 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.863605 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.863605 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.864059 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.864233 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.864386 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.864529 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.864680 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.864829 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.865094 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.865279 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.865438 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.865617 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.865775 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.865925 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.866068 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.866260 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.866516 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.867231 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.867526 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.867775 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.868250 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.868250 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.868553 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.868697 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.868857 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.869007 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.869149 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.869438 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.869590 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.869755 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.869949 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.870103 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.870255 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.870409 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.870559 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.870716 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.870859 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.871008 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.871149 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.871290 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.871439 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.871594 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.871738 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.871879 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.872044 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.872193 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.872345 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.872503 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.872662 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.872814 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.872963 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.873106 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.873261 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.873412 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.873552 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.873701 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.873850 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.873993 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.874315 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.874474 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.874625 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.874770 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.874920 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.875075 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.875218 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.875367 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.875516 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.875666 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.875808 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.875962 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.876156 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.876311 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.876454 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.876612 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.876754 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.876910 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.876910 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.877195 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.877343 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.877489 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.877638 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.877790 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.877938 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.878091 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.878232 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.878380 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.878531 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.878954 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.879110 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.879260 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.879403 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.879543 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.879694 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.879836 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.879985 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.880156 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.880259 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.880357 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.880457 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.880545 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.880629 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.880713 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.880798 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.880881 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.880980 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.881074 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.881166 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.881251 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.881343 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.881441 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.881534 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.881619 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.881702 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.881824 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.881927 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.882145 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.882248 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.883012 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.883119 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.883349 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.883452 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.883668 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.883786 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.884000 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.884125 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.884338 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.884439 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.884663 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.884765 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.884975 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.885075 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.885285 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.885388 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.885616 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.885732 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.885938 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.886064 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.886257 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.886481 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.886576 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.886840 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.886934 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.887167 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.887261 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.887493 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.887584 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.887797 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.887903 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.888132 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.888231 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.888452 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.888547 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.888774 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.888873 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.889084 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.889191 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.889398 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.889490 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.889709 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.889809 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.890026 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.890196 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.890338 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.890436 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.890646 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.890738 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.890960 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.891066 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.891275 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.891373 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.891588 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.891682 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.891906 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.892008 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.892247 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.892352 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.892561 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.892660 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.892877 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.892969 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.893190 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.893288 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.893498 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.893589 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.893812 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.893911 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.894124 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.894237 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.894428 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.894520 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.894739 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.894832 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.895050 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.895151 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.895362 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.895457 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.895668 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.895770 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.895983 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.896191 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.896352 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.896515 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.896667 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.896816 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.896974 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.897140 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.897298 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.897456 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.897630 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.897785 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.897945 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.898136 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.898326 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.898541 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.898734 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.898928 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.899081 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.899257 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.899414 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.899578 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.899735 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.899891 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.900066 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.900233 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.900394 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.900542 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.900697 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.900844 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.900991 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.901147 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.901309 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.901458 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.901612 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.901771 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.901928 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.902084 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.902274 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.902429 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.902585 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.902741 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.902991 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.903163 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.903359 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.903522 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.903670 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.903836 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.904004 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.904179 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.904340 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.904667 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.904833 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.904983 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.905140 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.905310 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.905458 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.905613 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.905763 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.905929 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.906706 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.906869 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.907026 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.907199 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.907350 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.907514 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.907664 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.907813 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.907961 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.908148 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.908316 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.908476 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.908674 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.908826 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.908975 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.909123 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.909282 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.909441 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.909607 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.909766 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.909926 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.910081 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.910308 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.910465 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.910615 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.910763 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.910918 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.910918 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.911226 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.911383 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.911542 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.911691 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.911846 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.911993 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.912176 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.912364 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.912364 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.912655 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.912813 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.912813 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.913107 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.913277 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.913426 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.913623 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.913623 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.913926 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.914074 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.914223 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.914370 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.914532 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.914873 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.915031 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.915188 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.915356 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.915525 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.915684 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.915841 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.915989 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.916171 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.916329 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.916493 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.916649 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.916828 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.916978 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.917136 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.917295 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.917469 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.917619 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.917773 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.917924 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.918072 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.918230 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.918396 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.918545 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.918701 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.918850 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.919005 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.919162 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.919310 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.919476 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.919625 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.919780 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.919930 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.920111 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.920267 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.920422 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.920572 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.920728 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.920876 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.921037 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.921186 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.921351 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.921500 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.921500 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.921790 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.921947 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.922111 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.922259 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.922408 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.922562 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.922724 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.922873 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.923021 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.923170 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.923336 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.923494 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.923651 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.923800 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.923948 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.924143 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.924264 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.924357 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.924495 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.924808 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.924932 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.925010 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.925105 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.925893 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.926001 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.926077 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.926169 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.926310 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.926394 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.926482 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.926587 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.926725 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.926854 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.927022 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.927153 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.927286 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.927366 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.927437 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.927508 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.927586 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.927658 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.927742 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.927815 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.927895 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.928406 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.928543 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.928644 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.928737 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.928812 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.928890 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.928971 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.929094 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.931223 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.931364 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.931497 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.931497 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.931677 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.931763 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.931855 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.931939 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.932045 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.932045 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.932230 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.932311 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.932515 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.932691 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.932843 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.933023 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.933152 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.933484 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.933627 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.933815 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.934146 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.934360 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.934553 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.934690 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.934840 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.935365 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.935676 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.935877 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.936106 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.936253 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.936253 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.936599 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.936721 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.936897 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.937025 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.937209 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.937520 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.937666 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.937932 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.938052 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.938202 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.938381 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.938576 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.938774 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.938910 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.939099 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.939245 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.939422 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.939561 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.939743 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.939884 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.940090 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.940243 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.940418 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.940549 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.940735 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.940866 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.941047 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.941186 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.941321 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 18:00:26.941450 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.941663 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.941998 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.942319 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.942633 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.942948 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.943259 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.943613 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.943925 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.944328 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.944643 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.945700 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.945873 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.946259 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.946848 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.946848 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.947176 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.947458 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.947778 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.948125 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.948439 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.948755 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.949085 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.949403 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.949723 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.950048 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.950378 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.950709 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.951024 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.951340 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.951663 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.951979 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.952321 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.952639 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.953112 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.953278 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.953595 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.953914 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.954231 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.954542 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.954860 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.955536 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.955536 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.955977 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.956168 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.956439 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.956756 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.957069 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.957417 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.957697 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.958139 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.958458 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.958778 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.959088 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.959403 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.959718 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.960105 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.960378 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.960890 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.961429 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.961648 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.961967 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.962288 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.962599 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.962909 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.963226 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.963555 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.963865 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.964202 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.964651 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.964857 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.965169 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.965508 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.966052 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.966259 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.966531 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.966952 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.967268 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.967585 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.967903 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.968266 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.968593 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.968904 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.969227 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.969529 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.969858 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.970195 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.970867 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.970867 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.971178 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.971430 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.971758 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.972100 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.972461 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.972854 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.973180 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.973497 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.973827 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.974162 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.974473 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.974782 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.975098 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.975421 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.975716 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.976062 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.976408 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.976724 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.977039 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.977354 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.977664 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.977974 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.978301 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.978684 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.978910 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.979225 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.979553 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.979879 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.980215 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.980544 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.980861 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.981172 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.981485 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.981797 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.982144 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.982454 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.982784 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.983114 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.983755 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.983755 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.984123 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.984417 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.984739 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.985063 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.985391 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.985702 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.986010 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.986380 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.986636 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.986944 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.987252 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.987567 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.988159 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.988471 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.988780 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.989107 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.989415 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.989744 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.990072 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.990379 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.990702 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.991000 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.991352 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.991662 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.992564 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.993006 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.993364 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.993703 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.994137 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.994368 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.994738 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.995015 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.995358 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.995802 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.996115 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.996546 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.996765 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.997083 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.997409 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.997734 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.998060 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.998648 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.998982 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.999303 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.999624 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:26.999940 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.000301 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.000622 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.000943 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.001262 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.001579 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.001900 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.002062 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO dbcounter [None req-5fda3b7b-ed50-4fc7-a1b4-f4768950e03b None None] Registered counter for database nova_api May 26 18:00:27.002227 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.002551 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.002884 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.003227 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.003577 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.003901 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.004252 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.004573 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.004940 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.005259 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.005572 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.005898 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.006219 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.006537 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.006855 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.007173 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.008095 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.008623 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.009023 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.009348 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.010281 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.010281 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.010644 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.010644 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.010997 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.011322 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.011643 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.011969 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.012599 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.012921 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.013319 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.013693 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.014032 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.014384 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.015102 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.015102 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.015612 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.015722 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.016080 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.016377 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.016690 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.017074 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.018160 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.018160 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.018666 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.018787 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.019369 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.019780 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.020107 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.020596 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.020925 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.021267 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.021672 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.022065 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.022389 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.022723 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.023218 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.023530 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_db.sqlalchemy.engines [None req-5fda3b7b-ed50-4fc7-a1b4-f4768950e03b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117723) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 18:00:27.023767 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.024145 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.024399 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.024717 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.025184 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.025354 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.025679 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.025999 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.026336 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.026652 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.027068 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.027271 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.027590 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.027904 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.028269 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.028556 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.028932 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.029188 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.029505 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.029824 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.030137 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.030477 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.030827 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.031147 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.031551 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.032087 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.032352 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.032697 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.033033 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.033355 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.033685 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.034269 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.034388 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.034675 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.035009 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.035289 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writer thread running {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 18:00:27.035722 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.035938 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.036415 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.036672 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.037014 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.037331 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.037659 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.037961 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.038295 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.038664 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.039145 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.039473 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.039888 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.040239 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.040559 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.040882 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.041203 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.041572 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.041853 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.042163 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.042480 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.042800 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.043151 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.043504 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.043830 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.044196 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.044523 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.044845 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.045162 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.045491 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.045796 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.046115 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.046441 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.046780 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.047099 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.047414 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.047852 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.048197 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.048525 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.048852 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.049168 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.049494 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.049823 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.050138 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.050568 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.051039 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.051625 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.052098 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.052507 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.052852 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.053168 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.053481 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.053794 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.054112 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.055184 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.055572 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.055911 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.056275 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.056601 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.056914 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.057234 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.057545 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.057861 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.058213 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.058538 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.058848 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.059156 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.059468 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.059779 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.060117 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.060441 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.060752 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.061063 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.061375 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.061688 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.062000 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.062333 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.062682 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.063000 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.063325 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.063642 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.063969 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.064325 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.064654 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.064980 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.065310 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.065634 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.065962 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.066279 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.066586 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.066906 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.067219 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.067537 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.067866 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.068218 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.068579 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.068893 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.069245 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.069572 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.069967 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.070909 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.071190 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.071540 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.071860 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.072235 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.072610 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.073037 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.073277 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.073809 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.073963 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.074284 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.074615 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.074960 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.075295 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.075630 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.075986 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.076333 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.076726 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.077068 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.077413 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.077755 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.078157 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:00:27.078365 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 18:00:27.107512 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.context [None req-5fda3b7b-ed50-4fc7-a1b4-f4768950e03b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),31d4fadf-23db-42ac-9fc1-5cb2101b75d4(cell1) {{(pid=117723) load_cells /opt/stack/nova/nova/context.py:464}} May 26 18:00:27.111971 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5fda3b7b-ed50-4fc7-a1b4-f4768950e03b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:27.113949 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5fda3b7b-ed50-4fc7-a1b4-f4768950e03b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:27.114877 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5fda3b7b-ed50-4fc7-a1b4-f4768950e03b None None] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:27.117619 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5fda3b7b-ed50-4fc7-a1b4-f4768950e03b None None] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:27.119776 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO dbcounter [None req-5fda3b7b-ed50-4fc7-a1b4-f4768950e03b None None] Registered counter for database nova_cell0 May 26 18:00:27.124490 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO dbcounter [None req-5fda3b7b-ed50-4fc7-a1b4-f4768950e03b None None] Registered counter for database nova_cell1 May 26 18:00:27.134515 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_db.sqlalchemy.engines [None req-5fda3b7b-ed50-4fc7-a1b4-f4768950e03b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117723) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 18:00:27.135892 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_db.sqlalchemy.engines [None req-5fda3b7b-ed50-4fc7-a1b4-f4768950e03b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117723) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 18:00:27.141949 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO dbcounter [None req-3275a944-98d3-440a-a811-b2ca26d46118 None None] Registered counter for database nova_api May 26 18:00:27.143379 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writer thread running {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 18:00:27.144924 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writer thread running {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 18:00:27.166569 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_db.sqlalchemy.engines [None req-3275a944-98d3-440a-a811-b2ca26d46118 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117722) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 18:00:27.175606 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writer thread running {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 18:00:27.234955 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.context [None req-3275a944-98d3-440a-a811-b2ca26d46118 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),31d4fadf-23db-42ac-9fc1-5cb2101b75d4(cell1) {{(pid=117722) load_cells /opt/stack/nova/nova/context.py:464}} May 26 18:00:27.239475 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3275a944-98d3-440a-a811-b2ca26d46118 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:27.241153 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3275a944-98d3-440a-a811-b2ca26d46118 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:27.242595 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3275a944-98d3-440a-a811-b2ca26d46118 None None] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:27.244652 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3275a944-98d3-440a-a811-b2ca26d46118 None None] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:27.246775 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO dbcounter [None req-3275a944-98d3-440a-a811-b2ca26d46118 None None] Registered counter for database nova_cell0 May 26 18:00:27.250909 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO dbcounter [None req-3275a944-98d3-440a-a811-b2ca26d46118 None None] Registered counter for database nova_cell1 May 26 18:00:27.261168 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_db.sqlalchemy.engines [None req-3275a944-98d3-440a-a811-b2ca26d46118 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117722) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 18:00:27.261962 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_db.sqlalchemy.engines [None req-3275a944-98d3-440a-a811-b2ca26d46118 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117722) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 18:00:27.269379 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writer thread running {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 18:00:27.270858 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writer thread running {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 18:00:27.307312 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO dbcounter [None req-5fda3b7b-ed50-4fc7-a1b4-f4768950e03b None None] Registered counter for database nova_cell0 May 26 18:00:27.315767 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_db.sqlalchemy.engines [None req-5fda3b7b-ed50-4fc7-a1b4-f4768950e03b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117723) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 18:00:27.324465 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writer thread running {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 18:00:27.453918 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO dbcounter [None req-3275a944-98d3-440a-a811-b2ca26d46118 None None] Registered counter for database nova_cell0 May 26 18:00:27.465861 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_db.sqlalchemy.engines [None req-3275a944-98d3-440a-a811-b2ca26d46118 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117722) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 18:00:27.480032 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writer thread running {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 18:00:27.697991 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: WARNING keystonemiddleware.auth_token [None req-5fda3b7b-ed50-4fc7-a1b4-f4768950e03b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 18:00:27.706376 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: WARNING keystonemiddleware.auth_token [None req-5fda3b7b-ed50-4fc7-a1b4-f4768950e03b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 18:00:27.834781 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: WARNING keystonemiddleware.auth_token [None req-3275a944-98d3-440a-a811-b2ca26d46118 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 18:00:27.842900 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: WARNING keystonemiddleware.auth_token [None req-3275a944-98d3-440a-a811-b2ca26d46118 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 18:00:28.065865 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: WARNING keystonemiddleware.auth_token [None req-5fda3b7b-ed50-4fc7-a1b4-f4768950e03b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 18:00:28.072395 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: WARNING keystonemiddleware.auth_token [None req-5fda3b7b-ed50-4fc7-a1b4-f4768950e03b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 18:00:28.077718 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e5f895a9c0 pid: 117723 (default app) May 26 18:00:28.202192 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: WARNING keystonemiddleware.auth_token [None req-3275a944-98d3-440a-a811-b2ca26d46118 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 18:00:28.208284 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: WARNING keystonemiddleware.auth_token [None req-3275a944-98d3-440a-a811-b2ca26d46118 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 18:00:28.214391 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e5f895a9c0 pid: 117722 (default app) May 26 18:01:12.182514 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-edcde867-ca7b-41a4-9c2a-bd5562c08263 tempest-VolumesTestJSON-501384037 tempest-VolumesTestJSON-501384037-project] Calling method '.version_select at 0x7f3ababa55e0>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:12.258048 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_api:SELECT=3 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:12.260352 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=3 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:12.265497 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell0:SELECT=3 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:12.266712 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell0:SELECT=3 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:13.257944 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-edcde867-ca7b-41a4-9c2a-bd5562c08263 tempest-VolumesTestJSON-501384037 tempest-VolumesTestJSON-501384037-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/8b1b62f7-bcf4-46e7-9fa8-9c010f23650b" status: 200 len: 350 microversion: 2.1 time: 1.524204 May 26 18:01:13.259833 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 1/1] 10.222.0.69 () {58 vars in 1244 bytes} [Thu May 26 18:01:11 2022] GET /compute/v2.1/os-volumes/8b1b62f7-bcf4-46e7-9fa8-9c010f23650b => generated 350 bytes in 1529 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:01:14.014618 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_api:SELECT=3 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:14.015616 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_cell1:SELECT=3 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:14.018329 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_cell0:SELECT=3 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:14.024804 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_cell0:SELECT=3 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:15.155511 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-02398478-d4a4-433b-9c55-5a6bdd427941 tempest-VolumesTestJSON-501384037 tempest-VolumesTestJSON-501384037-project] Calling method '.version_select at 0x7f3abaa6cc10>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:15.185573 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-ef3ae78d-8c0d-429c-97fb-e1a61e1a50e7 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-161410467", "imageRef": "16351c96-cb02-4711-99d5-fd4d80e8a846", "flavorRef": "452", "networks": [{"uuid": "6b9b5b4a-a88b-47f5-b18b-d8928aa5e340"}]}} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:01:15.284084 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-02398478-d4a4-433b-9c55-5a6bdd427941 tempest-VolumesTestJSON-501384037 tempest-VolumesTestJSON-501384037-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/afcaae3f-efb4-450c-8543-742259472263" status: 200 len: 351 microversion: 2.1 time: 0.143510 May 26 18:01:15.290424 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 2/2] 10.222.0.69 () {58 vars in 1244 bytes} [Thu May 26 18:01:15 2022] GET /compute/v2.1/os-volumes/afcaae3f-efb4-450c-8543-742259472263 => generated 351 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:01:15.888203 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.network.neutron [None req-ef3ae78d-8c0d-429c-97fb-e1a61e1a50e7 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] validate_networks() for [('6b9b5b4a-a88b-47f5-b18b-d8928aa5e340', None, None, None, None, None)] {{(pid=117722) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:01:17.410446 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-948fbe66-3c23-443d-a8ed-63c42215ae1a tempest-VolumesTestJSON-501384037 tempest-VolumesTestJSON-501384037-project] Calling method '.version_select at 0x7f3abaa6cb80>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:17.538140 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-948fbe66-3c23-443d-a8ed-63c42215ae1a tempest-VolumesTestJSON-501384037 tempest-VolumesTestJSON-501384037-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/c6751d05-47bb-4be6-8b9c-8cbdd7a3e848" status: 200 len: 350 microversion: 2.1 time: 0.142894 May 26 18:01:17.540497 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 3/3] 10.222.0.69 () {58 vars in 1244 bytes} [Thu May 26 18:01:17 2022] GET /compute/v2.1/os-volumes/c6751d05-47bb-4be6-8b9c-8cbdd7a3e848 => generated 350 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:01:17.554876 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-0be34b0b-754a-4d79-b999-fef035886a35 tempest-VolumesTestJSON-501384037 tempest-VolumesTestJSON-501384037-project] Calling method '.version_select at 0x7f3abaa30430>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:17.797275 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-0be34b0b-754a-4d79-b999-fef035886a35 tempest-VolumesTestJSON-501384037 tempest-VolumesTestJSON-501384037-project] 10.222.0.69 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.249388 May 26 18:01:17.799179 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 4/4] 10.222.0.69 () {58 vars in 1133 bytes} [Thu May 26 18:01:17 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:17.812585 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-1598bbe2-9513-46c3-9530-7a5062a0430a tempest-VolumesTestJSON-501384037 tempest-VolumesTestJSON-501384037-project] Calling method '.version_select at 0x7f3abaa6c8b0>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:18.038866 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-1598bbe2-9513-46c3-9530-7a5062a0430a tempest-VolumesTestJSON-501384037 tempest-VolumesTestJSON-501384037-project] 10.222.0.69 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.230928 May 26 18:01:18.039342 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 5/5] 10.222.0.69 () {58 vars in 1148 bytes} [Thu May 26 18:01:17 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:01:18.052966 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-b3b47e04-4cf7-4bb3-bac3-990f470bb2c9 tempest-VolumesTestJSON-501384037 tempest-VolumesTestJSON-501384037-project] Calling method '.version_select at 0x7f3abaa303a0>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:18.393570 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-b3b47e04-4cf7-4bb3-bac3-990f470bb2c9 tempest-VolumesTestJSON-501384037 tempest-VolumesTestJSON-501384037-project] 10.222.0.69 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.344645 May 26 18:01:18.394427 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 6/6] 10.222.0.69 () {58 vars in 1133 bytes} [Thu May 26 18:01:18 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:01:18.407840 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-6914e62b-6c08-444d-8bd3-106016741552 tempest-VolumesTestJSON-501384037 tempest-VolumesTestJSON-501384037-project] Calling method '.version_select at 0x7f3abaa42550>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:18.623178 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-6914e62b-6c08-444d-8bd3-106016741552 tempest-VolumesTestJSON-501384037 tempest-VolumesTestJSON-501384037-project] 10.222.0.69 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.218978 May 26 18:01:18.623749 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 7/7] 10.222.0.69 () {58 vars in 1166 bytes} [Thu May 26 18:01:18 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:01:18.639077 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-26a9e32c-228f-4063-8b84-8127362c93d2 tempest-VolumesTestJSON-501384037 tempest-VolumesTestJSON-501384037-project] Calling method '.version_select at 0x7f3abaa30dc0>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:18.830543 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-26a9e32c-228f-4063-8b84-8127362c93d2 tempest-VolumesTestJSON-501384037 tempest-VolumesTestJSON-501384037-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.195148 May 26 18:01:18.831114 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 8/8] 10.222.0.69 () {58 vars in 1169 bytes} [Thu May 26 18:01:18 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:01:18.843780 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-1dbf76fe-f134-4f13-add8-f52ea9eda690 tempest-VolumesTestJSON-501384037 tempest-VolumesTestJSON-501384037-project] Calling method '.version_select at 0x7f3abb290c10>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:19.056808 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-1dbf76fe-f134-4f13-add8-f52ea9eda690 tempest-VolumesTestJSON-501384037 tempest-VolumesTestJSON-501384037-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.216222 May 26 18:01:19.058002 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 9/9] 10.222.0.69 () {58 vars in 1154 bytes} [Thu May 26 18:01:18 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:01:19.071192 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-a30261b9-eddd-4870-944f-217b2f57f5f2 tempest-VolumesTestJSON-501384037 tempest-VolumesTestJSON-501384037-project] Calling method '.version_select at 0x7f3abaa42af0>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:19.110156 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.virt.hardware [None req-ef3ae78d-8c0d-429c-97fb-e1a61e1a50e7 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Flavor limits 0:0:0 {{(pid=117722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:01:19.110964 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.virt.hardware [None req-ef3ae78d-8c0d-429c-97fb-e1a61e1a50e7 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Image limits 0:0:0 {{(pid=117722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:01:19.111527 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.virt.hardware [None req-ef3ae78d-8c0d-429c-97fb-e1a61e1a50e7 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Flavor pref 0:0:0 {{(pid=117722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:01:19.112088 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.virt.hardware [None req-ef3ae78d-8c0d-429c-97fb-e1a61e1a50e7 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Image pref 0:0:0 {{(pid=117722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:01:19.112861 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.virt.hardware [None req-ef3ae78d-8c0d-429c-97fb-e1a61e1a50e7 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:01:19.154290 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ef3ae78d-8c0d-429c-97fb-e1a61e1a50e7 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:19.155310 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ef3ae78d-8c0d-429c-97fb-e1a61e1a50e7 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:19.161957 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ef3ae78d-8c0d-429c-97fb-e1a61e1a50e7 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:19.167138 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ef3ae78d-8c0d-429c-97fb-e1a61e1a50e7 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:19.247550 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.quota [None req-ef3ae78d-8c0d-429c-97fb-e1a61e1a50e7 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Getting quotas for project 41aaf61888b149a59ed741d201490e52. Resources: {'instances', 'ram', 'cores'} {{(pid=117722) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:01:19.254952 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.quota [None req-ef3ae78d-8c0d-429c-97fb-e1a61e1a50e7 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Getting quotas for user 9caae6984c3b47c59f8b385af0b40f98 and project 41aaf61888b149a59ed741d201490e52. Resources: {'instances', 'ram', 'cores'} {{(pid=117722) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:01:19.271028 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-ef3ae78d-8c0d-429c-97fb-e1a61e1a50e7 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Going to run 1 instances... {{(pid=117722) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:01:19.275913 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-ef3ae78d-8c0d-429c-97fb-e1a61e1a50e7 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] [instance: 597e2bca-7106-4c57-9ce3-b73108629960] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='16351c96-cb02-4711-99d5-fd4d80e8a846',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:01:19.321524 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-a30261b9-eddd-4870-944f-217b2f57f5f2 tempest-VolumesTestJSON-501384037 tempest-VolumesTestJSON-501384037-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.254951 May 26 18:01:19.322396 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 10/10] 10.222.0.69 () {58 vars in 1187 bytes} [Thu May 26 18:01:19 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:01:19.335643 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-667804b5-77f1-46be-a693-027cf3acb357 tempest-VolumesTestJSON-501384037 tempest-VolumesTestJSON-501384037-project] Calling method '.version_select at 0x7f3abaa6c8b0>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:19.438513 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-ef3ae78d-8c0d-429c-97fb-e1a61e1a50e7 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.433433 May 26 18:01:19.439401 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 1/11] 10.222.0.69 () {60 vars in 1146 bytes} [Thu May 26 18:01:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 5437 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 18:01:19.450501 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-c3c21582-148c-441d-8543-ca5af8348d34 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:19.452450 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-c3c21582-148c-441d-8543-ca5af8348d34 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] [instance: 597e2bca-7106-4c57-9ce3-b73108629960] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:19.559320 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-667804b5-77f1-46be-a693-027cf3acb357 tempest-VolumesTestJSON-501384037 tempest-VolumesTestJSON-501384037-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.227876 May 26 18:01:19.559980 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 11/12] 10.222.0.69 () {58 vars in 1154 bytes} [Thu May 26 18:01:19 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:01:19.938952 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-c3c21582-148c-441d-8543-ca5af8348d34 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caae6984c3b47c59f8b385af0b40f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41aaf61888b149a59ed741d201490e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:19.955975 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-c3c21582-148c-441d-8543-ca5af8348d34 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] 10.222.0.69 "GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960" status: 200 len: 1214 microversion: 2.1 time: 0.509719 May 26 18:01:19.966804 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 2/13] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:01:19 2022] GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960 => generated 1214 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:20.975287 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-889e01cf-e7ce-4245-b015-07837f085198 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:20.976785 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-889e01cf-e7ce-4245-b015-07837f085198 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] [instance: 597e2bca-7106-4c57-9ce3-b73108629960] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:21.282139 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-889e01cf-e7ce-4245-b015-07837f085198 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caae6984c3b47c59f8b385af0b40f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41aaf61888b149a59ed741d201490e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:21.300344 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-889e01cf-e7ce-4245-b015-07837f085198 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] 10.222.0.69 "GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960" status: 200 len: 1214 microversion: 2.1 time: 0.329915 May 26 18:01:21.319515 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 12/14] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:01:20 2022] GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960 => generated 1214 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:22.329820 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-82071bbc-16d0-48dd-834b-7e5078bf8a07 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:22.330435 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-82071bbc-16d0-48dd-834b-7e5078bf8a07 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] [instance: 597e2bca-7106-4c57-9ce3-b73108629960] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:22.350528 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-82071bbc-16d0-48dd-834b-7e5078bf8a07 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:22.350991 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-82071bbc-16d0-48dd-834b-7e5078bf8a07 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:22.351791 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-82071bbc-16d0-48dd-834b-7e5078bf8a07 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:22.352258 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-82071bbc-16d0-48dd-834b-7e5078bf8a07 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:22.909421 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-e84c5a77-56b2-46ef-8f2e-f2cf42badabb tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Action: 'create', calling method: .version_select at 0x7f3aba175dc0>, body: {"keypair": {"name": "tempest-keypair-19181237", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPlcbq+NOEZTeiQ53sg+tsU18RpAHfa9a/2cQyrL9yrfl5BWYGshJoWKwbprH5rlGwPladZOT3EmiKwTkXIOy0CblJeaXvgVk43WrA9Dz2cUseXjOJo2g06Sf2ko+1PwRg=="}} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:01:22.911239 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-82071bbc-16d0-48dd-834b-7e5078bf8a07 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caae6984c3b47c59f8b385af0b40f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41aaf61888b149a59ed741d201490e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:22.942634 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-82071bbc-16d0-48dd-834b-7e5078bf8a07 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] 10.222.0.69 "GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960" status: 200 len: 1210 microversion: 2.1 time: 0.616687 May 26 18:01:22.944707 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 13/15] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:01:22 2022] GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960 => generated 1210 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:22.967843 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.quota [None req-e84c5a77-56b2-46ef-8f2e-f2cf42badabb tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Getting quotas for project ab53cc69f7b0424cb689317c4be9b685. Resources: {'key_pairs'} {{(pid=117722) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:01:22.992534 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.quota [None req-e84c5a77-56b2-46ef-8f2e-f2cf42badabb tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Getting quotas for user a7cc6fcd7b4c4cee8d21e2692757aaf6 and project ab53cc69f7b0424cb689317c4be9b685. Resources: {'key_pairs'} {{(pid=117722) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:01:23.088898 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-e84c5a77-56b2-46ef-8f2e-f2cf42badabb tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 1.188360 May 26 18:01:23.106529 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 3/16] 10.222.0.69 () {62 vars in 1199 bytes} [Thu May 26 18:01:21 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 1207 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 26 18:01:23.962818 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-ae7b0d19-cc3e-4b73-8790-50079cf73468 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:23.964314 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-ae7b0d19-cc3e-4b73-8790-50079cf73468 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] [instance: 597e2bca-7106-4c57-9ce3-b73108629960] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:23.981915 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ae7b0d19-cc3e-4b73-8790-50079cf73468 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:23.983833 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ae7b0d19-cc3e-4b73-8790-50079cf73468 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:23.989708 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ae7b0d19-cc3e-4b73-8790-50079cf73468 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:23.991560 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ae7b0d19-cc3e-4b73-8790-50079cf73468 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:24.632951 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-ae7b0d19-cc3e-4b73-8790-50079cf73468 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caae6984c3b47c59f8b385af0b40f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41aaf61888b149a59ed741d201490e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:24.646755 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-ae7b0d19-cc3e-4b73-8790-50079cf73468 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] 10.222.0.69 "GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960" status: 200 len: 1272 microversion: 2.1 time: 0.689587 May 26 18:01:24.653197 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 14/17] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:01:23 2022] GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960 => generated 1272 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:25.668785 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-207d0984-5089-49e8-9ed9-438a59c07d29 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:25.670689 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-207d0984-5089-49e8-9ed9-438a59c07d29 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] [instance: 597e2bca-7106-4c57-9ce3-b73108629960] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:25.705636 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-207d0984-5089-49e8-9ed9-438a59c07d29 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:25.709019 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-207d0984-5089-49e8-9ed9-438a59c07d29 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:25.714269 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-207d0984-5089-49e8-9ed9-438a59c07d29 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:25.717673 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-207d0984-5089-49e8-9ed9-438a59c07d29 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:26.480075 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-207d0984-5089-49e8-9ed9-438a59c07d29 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caae6984c3b47c59f8b385af0b40f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41aaf61888b149a59ed741d201490e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:26.509331 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-207d0984-5089-49e8-9ed9-438a59c07d29 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] 10.222.0.69 "GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960" status: 200 len: 1272 microversion: 2.1 time: 0.848962 May 26 18:01:26.522349 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 4/18] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:01:25 2022] GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960 => generated 1272 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:27.539301 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-8338e882-34b0-460e-8e68-0c3f0bd42592 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:27.540673 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-8338e882-34b0-460e-8e68-0c3f0bd42592 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] [instance: 597e2bca-7106-4c57-9ce3-b73108629960] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:27.553500 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8338e882-34b0-460e-8e68-0c3f0bd42592 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:27.556202 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8338e882-34b0-460e-8e68-0c3f0bd42592 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:27.557205 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8338e882-34b0-460e-8e68-0c3f0bd42592 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:27.557783 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8338e882-34b0-460e-8e68-0c3f0bd42592 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:27.952984 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-8338e882-34b0-460e-8e68-0c3f0bd42592 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caae6984c3b47c59f8b385af0b40f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41aaf61888b149a59ed741d201490e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:27.961107 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-8338e882-34b0-460e-8e68-0c3f0bd42592 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] 10.222.0.69 "GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960" status: 200 len: 1314 microversion: 2.1 time: 0.426982 May 26 18:01:27.984511 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 15/19] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:01:27 2022] GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960 => generated 1314 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:28.595119 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-086aca58-1b0d-4b41-a56d-93dc980a6e05 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Action: 'create', calling method: .version_select at 0x7f3ab90c1700>, body: {"keypair": {"name": "tempest-keypair-1311237862", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLE8S8sDrNizkxHaWlINVpWNJZtWGg3BqQQbVTZe0kHjJLkcKqTM4MwTycvPb2JvTEjU1tq+OsXDYr9Xqsa2coPi5fNYChVDVfZmBoPxRAbEBOMmi6ivBYxO0S6ccK/tyQ=="}} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:01:28.652467 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.quota [None req-086aca58-1b0d-4b41-a56d-93dc980a6e05 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Getting quotas for project 79f8f4d1e7da4bfe9629717a86ba0def. Resources: {'key_pairs'} {{(pid=117722) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:01:28.682356 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.quota [None req-086aca58-1b0d-4b41-a56d-93dc980a6e05 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Getting quotas for user a95761f42af64635b051051e397d0fd1 and project 79f8f4d1e7da4bfe9629717a86ba0def. Resources: {'key_pairs'} {{(pid=117722) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:01:28.795131 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-086aca58-1b0d-4b41-a56d-93dc980a6e05 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.733810 May 26 18:01:28.797426 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 5/20] 10.222.0.69 () {60 vars in 1158 bytes} [Thu May 26 18:01:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:01:28.991108 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-5a0f9e72-b654-4321-b21f-e97422812cd8 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:28.992041 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-5a0f9e72-b654-4321-b21f-e97422812cd8 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] [instance: 597e2bca-7106-4c57-9ce3-b73108629960] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:29.011813 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5a0f9e72-b654-4321-b21f-e97422812cd8 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:29.013330 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5a0f9e72-b654-4321-b21f-e97422812cd8 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:29.017068 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5a0f9e72-b654-4321-b21f-e97422812cd8 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:29.022282 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5a0f9e72-b654-4321-b21f-e97422812cd8 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:31.300290 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell0:SELECT=2 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:31.388601 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-34b3f165-55ec-4b2e-8d40-d4bb47957f86 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1099861322", "imageRef": "16351c96-cb02-4711-99d5-fd4d80e8a846", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2cd2844c-2075-4a75-ad58-855aef5bd960"}], "security_groups": [{"name": "tempest-securitygroup--1373017494"}], "key_name": "tempest-keypair-19181237", "user_data": "}} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:01:31.464929 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_cell0:SELECT=2 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:31.758356 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-5a0f9e72-b654-4321-b21f-e97422812cd8 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caae6984c3b47c59f8b385af0b40f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41aaf61888b149a59ed741d201490e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:31.775069 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-5a0f9e72-b654-4321-b21f-e97422812cd8 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] 10.222.0.69 "GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960" status: 200 len: 1314 microversion: 2.1 time: 2.787997 May 26 18:01:31.777583 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 16/21] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:01:28 2022] GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960 => generated 1314 bytes in 2791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:32.320720 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.network.neutron [None req-34b3f165-55ec-4b2e-8d40-d4bb47957f86 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] validate_networks() for [('2cd2844c-2075-4a75-ad58-855aef5bd960', None, None, None, None, None)] {{(pid=117722) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:01:32.796432 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-fbde12f2-7d60-4a55-b8bf-af34fd17b578 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:32.798314 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-fbde12f2-7d60-4a55-b8bf-af34fd17b578 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] [instance: 597e2bca-7106-4c57-9ce3-b73108629960] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:32.816145 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fbde12f2-7d60-4a55-b8bf-af34fd17b578 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:32.817222 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fbde12f2-7d60-4a55-b8bf-af34fd17b578 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:32.818269 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fbde12f2-7d60-4a55-b8bf-af34fd17b578 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:32.818720 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fbde12f2-7d60-4a55-b8bf-af34fd17b578 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:33.515133 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-fbde12f2-7d60-4a55-b8bf-af34fd17b578 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caae6984c3b47c59f8b385af0b40f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41aaf61888b149a59ed741d201490e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:33.527114 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-fbde12f2-7d60-4a55-b8bf-af34fd17b578 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] 10.222.0.69 "GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960" status: 200 len: 1314 microversion: 2.1 time: 0.735836 May 26 18:01:33.529632 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 17/22] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:01:32 2022] GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960 => generated 1314 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:01:34.160166 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.virt.hardware [None req-34b3f165-55ec-4b2e-8d40-d4bb47957f86 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Flavor limits 0:0:0 {{(pid=117722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:01:34.160717 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.virt.hardware [None req-34b3f165-55ec-4b2e-8d40-d4bb47957f86 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Image limits 0:0:0 {{(pid=117722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:01:34.161074 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.virt.hardware [None req-34b3f165-55ec-4b2e-8d40-d4bb47957f86 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Flavor pref 0:0:0 {{(pid=117722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:01:34.161918 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.virt.hardware [None req-34b3f165-55ec-4b2e-8d40-d4bb47957f86 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Image pref 0:0:0 {{(pid=117722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:01:34.162929 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.virt.hardware [None req-34b3f165-55ec-4b2e-8d40-d4bb47957f86 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:01:34.196998 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-34b3f165-55ec-4b2e-8d40-d4bb47957f86 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:34.201436 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-34b3f165-55ec-4b2e-8d40-d4bb47957f86 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:34.202821 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-34b3f165-55ec-4b2e-8d40-d4bb47957f86 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:34.221807 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-34b3f165-55ec-4b2e-8d40-d4bb47957f86 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:34.263081 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.quota [None req-34b3f165-55ec-4b2e-8d40-d4bb47957f86 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Getting quotas for project ab53cc69f7b0424cb689317c4be9b685. Resources: {'instances', 'ram', 'cores'} {{(pid=117722) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:01:34.267656 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.quota [None req-34b3f165-55ec-4b2e-8d40-d4bb47957f86 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Getting quotas for user a7cc6fcd7b4c4cee8d21e2692757aaf6 and project ab53cc69f7b0424cb689317c4be9b685. Resources: {'instances', 'ram', 'cores'} {{(pid=117722) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:01:34.286613 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-34b3f165-55ec-4b2e-8d40-d4bb47957f86 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Going to run 1 instances... {{(pid=117722) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:01:34.289297 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-34b3f165-55ec-4b2e-8d40-d4bb47957f86 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='16351c96-cb02-4711-99d5-fd4d80e8a846',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:01:34.402077 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-34b3f165-55ec-4b2e-8d40-d4bb47957f86 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.018192 May 26 18:01:34.405570 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 6/23] 10.222.0.69 () {62 vars in 1187 bytes} [Thu May 26 18:01:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 3022 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 26 18:01:34.418539 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-d0e736e1-9891-46e5-af7b-80219e627d9e tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:34.422805 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-d0e736e1-9891-46e5-af7b-80219e627d9e tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:34.555043 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-723f7536-0992-490e-b377-a0131cb5bf7c tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:34.555681 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-723f7536-0992-490e-b377-a0131cb5bf7c tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] [instance: 597e2bca-7106-4c57-9ce3-b73108629960] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:34.583240 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-723f7536-0992-490e-b377-a0131cb5bf7c tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:34.583910 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-723f7536-0992-490e-b377-a0131cb5bf7c tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:34.586212 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-723f7536-0992-490e-b377-a0131cb5bf7c tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:34.588311 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-723f7536-0992-490e-b377-a0131cb5bf7c tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:35.150125 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-723f7536-0992-490e-b377-a0131cb5bf7c tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caae6984c3b47c59f8b385af0b40f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41aaf61888b149a59ed741d201490e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:35.160485 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-723f7536-0992-490e-b377-a0131cb5bf7c tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] 10.222.0.69 "GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960" status: 200 len: 1314 microversion: 2.1 time: 0.613473 May 26 18:01:35.171157 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 7/24] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:01:34 2022] GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960 => generated 1314 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:01:35.261316 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-d0e736e1-9891-46e5-af7b-80219e627d9e tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:35.273149 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-d0e736e1-9891-46e5-af7b-80219e627d9e tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:35.276494 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-d0e736e1-9891-46e5-af7b-80219e627d9e tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:35.283599 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-d0e736e1-9891-46e5-af7b-80219e627d9e tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1280 microversion: 2.20 time: 0.871019 May 26 18:01:35.286237 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 18/25] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:01:34 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1280 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:01:36.179039 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-761db132-8d14-4a2f-b7e7-790f7426fd13 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:36.180741 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-761db132-8d14-4a2f-b7e7-790f7426fd13 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] [instance: 597e2bca-7106-4c57-9ce3-b73108629960] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:36.199762 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-761db132-8d14-4a2f-b7e7-790f7426fd13 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:36.200458 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-761db132-8d14-4a2f-b7e7-790f7426fd13 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:36.201308 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-761db132-8d14-4a2f-b7e7-790f7426fd13 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:36.201783 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-761db132-8d14-4a2f-b7e7-790f7426fd13 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:36.437631 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [req-d050b80e-a3c6-4474-a6f2-2780e0926bdb req-8fdfc256-7c83-4c2d-be93-9ea7ae9f0de8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "597e2bca-7106-4c57-9ce3-b73108629960", "tag": "286236cd-e1bf-4690-8d1b-f843a4d0118f"}]} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:01:36.457100 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-d050b80e-a3c6-4474-a6f2-2780e0926bdb req-8fdfc256-7c83-4c2d-be93-9ea7ae9f0de8 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:36.457811 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-d050b80e-a3c6-4474-a6f2-2780e0926bdb req-8fdfc256-7c83-4c2d-be93-9ea7ae9f0de8 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:36.511448 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.compute.server_external_events [req-d050b80e-a3c6-4474-a6f2-2780e0926bdb req-8fdfc256-7c83-4c2d-be93-9ea7ae9f0de8 service nova] Creating event network-changed:286236cd-e1bf-4690-8d1b-f843a4d0118f for instance 597e2bca-7106-4c57-9ce3-b73108629960 on hv-cinder-83607 May 26 18:01:36.515269 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-d050b80e-a3c6-4474-a6f2-2780e0926bdb req-8fdfc256-7c83-4c2d-be93-9ea7ae9f0de8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117722) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 26 18:01:36.517050 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b2af1194-3bc6-4510-a60a-3e4a27cf5588 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:36.517499 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b2af1194-3bc6-4510-a60a-3e4a27cf5588 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:36.519490 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b2af1194-3bc6-4510-a60a-3e4a27cf5588 None None] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:36.521210 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b2af1194-3bc6-4510-a60a-3e4a27cf5588 None None] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:36.531538 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.compute.rpcapi [None req-b2af1194-3bc6-4510-a60a-3e4a27cf5588 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 26 18:01:36.532929 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b2af1194-3bc6-4510-a60a-3e4a27cf5588 None None] Releasing lock "compute-rpcapi-router" {{(pid=117722) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 26 18:01:36.589844 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-b2af1194-3bc6-4510-a60a-3e4a27cf5588 None None] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.416640 May 26 18:01:36.590503 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 8/26] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:01:36.607700 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-45ed8de1-68e8-4d82-aabd-ec495f448e5c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:36.609340 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-45ed8de1-68e8-4d82-aabd-ec495f448e5c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:36.633761 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-45ed8de1-68e8-4d82-aabd-ec495f448e5c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:36.634225 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-45ed8de1-68e8-4d82-aabd-ec495f448e5c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:36.635021 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-45ed8de1-68e8-4d82-aabd-ec495f448e5c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:36.647036 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-45ed8de1-68e8-4d82-aabd-ec495f448e5c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:36.963340 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-45ed8de1-68e8-4d82-aabd-ec495f448e5c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:36.972848 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-45ed8de1-68e8-4d82-aabd-ec495f448e5c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:36.979254 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-45ed8de1-68e8-4d82-aabd-ec495f448e5c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:36.993075 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-45ed8de1-68e8-4d82-aabd-ec495f448e5c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1284 microversion: 2.20 time: 0.401254 May 26 18:01:37.004407 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 9/27] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:01:36 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1284 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:01:38.030788 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-a920c1b8-8854-4b43-b0be-c2e04e67fcc2 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:38.031635 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-a920c1b8-8854-4b43-b0be-c2e04e67fcc2 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:38.051911 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-a920c1b8-8854-4b43-b0be-c2e04e67fcc2 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:38.052666 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-a920c1b8-8854-4b43-b0be-c2e04e67fcc2 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:38.058852 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-a920c1b8-8854-4b43-b0be-c2e04e67fcc2 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:38.061329 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-a920c1b8-8854-4b43-b0be-c2e04e67fcc2 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:38.229051 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-761db132-8d14-4a2f-b7e7-790f7426fd13 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caae6984c3b47c59f8b385af0b40f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41aaf61888b149a59ed741d201490e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:38.246050 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-761db132-8d14-4a2f-b7e7-790f7426fd13 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] 10.222.0.69 "GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960" status: 200 len: 1314 microversion: 2.1 time: 2.072229 May 26 18:01:38.260262 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 19/28] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:01:36 2022] GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960 => generated 1314 bytes in 2078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:01:38.369875 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-a920c1b8-8854-4b43-b0be-c2e04e67fcc2 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:38.384404 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-a920c1b8-8854-4b43-b0be-c2e04e67fcc2 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:38.394964 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-a920c1b8-8854-4b43-b0be-c2e04e67fcc2 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:38.405340 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-a920c1b8-8854-4b43-b0be-c2e04e67fcc2 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1340 microversion: 2.20 time: 0.388219 May 26 18:01:38.409940 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 10/29] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:01:38 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1340 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:01:39.282739 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-fe21620c-1e2c-49e3-84be-944e652304dd tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:39.283456 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-fe21620c-1e2c-49e3-84be-944e652304dd tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] [instance: 597e2bca-7106-4c57-9ce3-b73108629960] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:39.294749 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fe21620c-1e2c-49e3-84be-944e652304dd tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:39.295246 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fe21620c-1e2c-49e3-84be-944e652304dd tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:39.298137 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fe21620c-1e2c-49e3-84be-944e652304dd tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:39.298785 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fe21620c-1e2c-49e3-84be-944e652304dd tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:39.429088 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-b27c1113-5b2b-43c7-a229-717b0118e41d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:39.429845 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-b27c1113-5b2b-43c7-a229-717b0118e41d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:39.440555 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b27c1113-5b2b-43c7-a229-717b0118e41d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:39.444554 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b27c1113-5b2b-43c7-a229-717b0118e41d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:39.445601 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b27c1113-5b2b-43c7-a229-717b0118e41d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:39.451354 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b27c1113-5b2b-43c7-a229-717b0118e41d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:39.719448 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-b27c1113-5b2b-43c7-a229-717b0118e41d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:39.728377 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-b27c1113-5b2b-43c7-a229-717b0118e41d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:39.738550 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-b27c1113-5b2b-43c7-a229-717b0118e41d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:39.739893 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-b27c1113-5b2b-43c7-a229-717b0118e41d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1338 microversion: 2.20 time: 0.315027 May 26 18:01:39.751265 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 11/30] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:01:39 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1338 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:01:40.397855 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-fe21620c-1e2c-49e3-84be-944e652304dd tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caae6984c3b47c59f8b385af0b40f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41aaf61888b149a59ed741d201490e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:40.419073 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-fe21620c-1e2c-49e3-84be-944e652304dd tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] 10.222.0.69 "GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960" status: 200 len: 1314 microversion: 2.1 time: 1.136661 May 26 18:01:40.421894 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 20/31] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:01:39 2022] GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960 => generated 1314 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:40.772526 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-09c77987-acd0-450c-8249-6f6e18d4a4fa tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:40.775680 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-09c77987-acd0-450c-8249-6f6e18d4a4fa tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:40.784220 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-09c77987-acd0-450c-8249-6f6e18d4a4fa tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:40.785665 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-09c77987-acd0-450c-8249-6f6e18d4a4fa tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:40.787624 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-09c77987-acd0-450c-8249-6f6e18d4a4fa tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:40.788307 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-09c77987-acd0-450c-8249-6f6e18d4a4fa tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:40.879563 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-09c77987-acd0-450c-8249-6f6e18d4a4fa tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:40.899706 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-09c77987-acd0-450c-8249-6f6e18d4a4fa tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:40.903569 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-09c77987-acd0-450c-8249-6f6e18d4a4fa tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:40.905413 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-09c77987-acd0-450c-8249-6f6e18d4a4fa tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1338 microversion: 2.20 time: 0.146108 May 26 18:01:40.906789 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 12/32] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:01:40 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1338 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:01:40.977217 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-7d68a2a9-c1c2-42fb-8130-a816d0f0486b tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-90027177", "imageRef": "16351c96-cb02-4711-99d5-fd4d80e8a846", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0bfb788b-88d8-4bf1-bef0-c0a994bf6666"}], "security_groups": [{"name": "tempest-securitygroup--1990067703"}], "key_name": "tempest-keypair-1311237862", "user_data": "}} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:01:41.195395 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.network.neutron [None req-7d68a2a9-c1c2-42fb-8130-a816d0f0486b tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] validate_networks() for [('0bfb788b-88d8-4bf1-bef0-c0a994bf6666', None, None, None, None, None)] {{(pid=117722) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:01:41.353416 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-9fa6cc14-0f32-49ef-8f72-412413dd3c84 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-238231281", "imageRef": "16351c96-cb02-4711-99d5-fd4d80e8a846", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:01:41.599141 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.network.neutron [None req-9fa6cc14-0f32-49ef-8f72-412413dd3c84 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] validate_networks() for [('18d1c3ca-82fe-45c8-9ec5-367933ffa4c4', None, None, None, None, None)] {{(pid=117723) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:01:42.077903 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.virt.hardware [None req-7d68a2a9-c1c2-42fb-8130-a816d0f0486b tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Flavor limits 0:0:0 {{(pid=117722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:01:42.078622 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.virt.hardware [None req-7d68a2a9-c1c2-42fb-8130-a816d0f0486b tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Image limits 0:0:0 {{(pid=117722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:01:42.078916 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.virt.hardware [None req-7d68a2a9-c1c2-42fb-8130-a816d0f0486b tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Flavor pref 0:0:0 {{(pid=117722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:01:42.079371 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.virt.hardware [None req-7d68a2a9-c1c2-42fb-8130-a816d0f0486b tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Image pref 0:0:0 {{(pid=117722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:01:42.079865 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.virt.hardware [None req-7d68a2a9-c1c2-42fb-8130-a816d0f0486b tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:01:42.106249 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7d68a2a9-c1c2-42fb-8130-a816d0f0486b tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:42.107173 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7d68a2a9-c1c2-42fb-8130-a816d0f0486b tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:42.108221 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7d68a2a9-c1c2-42fb-8130-a816d0f0486b tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:42.108706 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7d68a2a9-c1c2-42fb-8130-a816d0f0486b tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:42.171719 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.quota [None req-7d68a2a9-c1c2-42fb-8130-a816d0f0486b tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Getting quotas for project 79f8f4d1e7da4bfe9629717a86ba0def. Resources: {'instances', 'ram', 'cores'} {{(pid=117722) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:01:42.179923 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.quota [None req-7d68a2a9-c1c2-42fb-8130-a816d0f0486b tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Getting quotas for user a95761f42af64635b051051e397d0fd1 and project 79f8f4d1e7da4bfe9629717a86ba0def. Resources: {'instances', 'ram', 'cores'} {{(pid=117722) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:01:42.210200 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-7d68a2a9-c1c2-42fb-8130-a816d0f0486b tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Going to run 1 instances... {{(pid=117722) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:01:42.212729 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-7d68a2a9-c1c2-42fb-8130-a816d0f0486b tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='16351c96-cb02-4711-99d5-fd4d80e8a846',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:01:42.326016 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-7d68a2a9-c1c2-42fb-8130-a816d0f0486b tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.357218 May 26 18:01:42.339717 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 13/33] 10.222.0.69 () {60 vars in 1146 bytes} [Thu May 26 18:01:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 1372 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 26 18:01:42.344719 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-7750ecff-2f66-43d8-ba1a-29830337e564 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:42.351659 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-7750ecff-2f66-43d8-ba1a-29830337e564 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] [instance: 597e2bca-7106-4c57-9ce3-b73108629960] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:42.374053 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7750ecff-2f66-43d8-ba1a-29830337e564 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:42.374510 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7750ecff-2f66-43d8-ba1a-29830337e564 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:42.375314 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7750ecff-2f66-43d8-ba1a-29830337e564 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:42.375755 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7750ecff-2f66-43d8-ba1a-29830337e564 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:42.704279 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-7750ecff-2f66-43d8-ba1a-29830337e564 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caae6984c3b47c59f8b385af0b40f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41aaf61888b149a59ed741d201490e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:42.724345 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-7750ecff-2f66-43d8-ba1a-29830337e564 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] 10.222.0.69 "GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960" status: 200 len: 1314 microversion: 2.1 time: 0.381184 May 26 18:01:42.736247 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 14/34] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:01:42 2022] GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960 => generated 1314 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:42.753234 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-6c10f1ce-a428-416b-863a-147426326a96 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:42.754191 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-6c10f1ce-a428-416b-863a-147426326a96 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:42.764124 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-6c10f1ce-a428-416b-863a-147426326a96 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:42.764975 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-6c10f1ce-a428-416b-863a-147426326a96 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:42.766187 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-6c10f1ce-a428-416b-863a-147426326a96 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:42.767316 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-6c10f1ce-a428-416b-863a-147426326a96 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:43.166431 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-6c10f1ce-a428-416b-863a-147426326a96 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:43.177600 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-6c10f1ce-a428-416b-863a-147426326a96 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:43.179198 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-6c10f1ce-a428-416b-863a-147426326a96 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:43.185591 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-6c10f1ce-a428-416b-863a-147426326a96 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1406 microversion: 2.20 time: 0.445493 May 26 18:01:43.199945 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 15/35] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:01:42 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1406 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:01:43.201525 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-9fa6cc14-0f32-49ef-8f72-412413dd3c84 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Flavor limits 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:01:43.201995 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-9fa6cc14-0f32-49ef-8f72-412413dd3c84 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Image limits 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:01:43.207770 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-9fa6cc14-0f32-49ef-8f72-412413dd3c84 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Flavor pref 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:01:43.208141 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-9fa6cc14-0f32-49ef-8f72-412413dd3c84 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Image pref 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:01:43.208569 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-9fa6cc14-0f32-49ef-8f72-412413dd3c84 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:01:43.209317 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-7bf13202-eea3-4800-83e1-61e5428c76e7 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:43.209965 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-7bf13202-eea3-4800-83e1-61e5428c76e7 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:43.214456 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:43.229293 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_api:SELECT=25 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:43.243798 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9fa6cc14-0f32-49ef-8f72-412413dd3c84 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:43.251392 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9fa6cc14-0f32-49ef-8f72-412413dd3c84 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:43.253666 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9fa6cc14-0f32-49ef-8f72-412413dd3c84 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:43.255594 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9fa6cc14-0f32-49ef-8f72-412413dd3c84 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:43.328834 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-9fa6cc14-0f32-49ef-8f72-412413dd3c84 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Getting quotas for project 53288d567a8f426bb068908db481e32e. Resources: {'instances', 'ram', 'cores'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:01:43.331430 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-7bf13202-eea3-4800-83e1-61e5428c76e7 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:43.342040 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-7bf13202-eea3-4800-83e1-61e5428c76e7 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1236 microversion: 2.1 time: 0.140051 May 26 18:01:43.343937 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 16/36] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:01:43 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1236 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:43.347979 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-9fa6cc14-0f32-49ef-8f72-412413dd3c84 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Getting quotas for user 5b5c8dedd274447da8ee4600feb6a26c and project 53288d567a8f426bb068908db481e32e. Resources: {'instances', 'ram', 'cores'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:01:43.363113 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-9fa6cc14-0f32-49ef-8f72-412413dd3c84 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Going to run 1 instances... {{(pid=117723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:01:43.367609 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-9fa6cc14-0f32-49ef-8f72-412413dd3c84 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 3e617476-1bcd-49f6-b16b-1513445fc759] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='16351c96-cb02-4711-99d5-fd4d80e8a846',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:01:43.478878 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-9fa6cc14-0f32-49ef-8f72-412413dd3c84 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.659310 May 26 18:01:43.479592 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 21/37] 10.222.0.69 () {60 vars in 1146 bytes} [Thu May 26 18:01:40 2022] POST /compute/v2.1/servers => generated 383 bytes in 2662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 18:01:43.491424 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-76f18749-29a1-499a-88dd-08e33e0a6b80 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:43.492101 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-76f18749-29a1-499a-88dd-08e33e0a6b80 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 3e617476-1bcd-49f6-b16b-1513445fc759] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:43.582171 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-76f18749-29a1-499a-88dd-08e33e0a6b80 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:43.593887 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-76f18749-29a1-499a-88dd-08e33e0a6b80 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759" status: 200 len: 1221 microversion: 2.1 time: 0.107556 May 26 18:01:43.594636 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 17/38] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:01:43 2022] GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759 => generated 1221 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:43.745893 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-80a34b9a-75fe-41e7-a253-ee2fc0b844cd tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:43.748792 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-80a34b9a-75fe-41e7-a253-ee2fc0b844cd tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] [instance: 597e2bca-7106-4c57-9ce3-b73108629960] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:43.770370 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-80a34b9a-75fe-41e7-a253-ee2fc0b844cd tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:43.771246 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-80a34b9a-75fe-41e7-a253-ee2fc0b844cd tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:43.772317 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-80a34b9a-75fe-41e7-a253-ee2fc0b844cd tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:43.772942 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-80a34b9a-75fe-41e7-a253-ee2fc0b844cd tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:43.949492 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-c7110c6e-ca05-453b-94c0-8506d689df01 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1668132851", "imageRef": "16351c96-cb02-4711-99d5-fd4d80e8a846", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:01:44.061160 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.network.neutron [None req-c7110c6e-ca05-453b-94c0-8506d689df01 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] validate_networks() for [('18d1c3ca-82fe-45c8-9ec5-367933ffa4c4', None, None, None, None, None)] {{(pid=117722) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:01:44.155214 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-80a34b9a-75fe-41e7-a253-ee2fc0b844cd tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caae6984c3b47c59f8b385af0b40f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41aaf61888b149a59ed741d201490e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:44.168431 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-80a34b9a-75fe-41e7-a253-ee2fc0b844cd tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] 10.222.0.69 "GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960" status: 200 len: 1314 microversion: 2.1 time: 0.428978 May 26 18:01:44.169023 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 22/39] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:01:43 2022] GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960 => generated 1314 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:44.207551 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-d2bf7b4d-dc0c-4a27-aee0-3c8bce0c05e3 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:44.208212 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-d2bf7b4d-dc0c-4a27-aee0-3c8bce0c05e3 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:44.235542 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d2bf7b4d-dc0c-4a27-aee0-3c8bce0c05e3 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:44.236598 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d2bf7b4d-dc0c-4a27-aee0-3c8bce0c05e3 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:44.237504 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d2bf7b4d-dc0c-4a27-aee0-3c8bce0c05e3 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:44.237970 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d2bf7b4d-dc0c-4a27-aee0-3c8bce0c05e3 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:44.687370 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-d2bf7b4d-dc0c-4a27-aee0-3c8bce0c05e3 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:44.711900 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-d2bf7b4d-dc0c-4a27-aee0-3c8bce0c05e3 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:44.723575 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-d2bf7b4d-dc0c-4a27-aee0-3c8bce0c05e3 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:44.724901 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-d2bf7b4d-dc0c-4a27-aee0-3c8bce0c05e3 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1406 microversion: 2.20 time: 0.521971 May 26 18:01:44.736253 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 23/40] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:01:44 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1406 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:01:44.745040 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-c7ee6f18-fe22-403f-8f6b-e78d773595ca tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:44.752451 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-c7ee6f18-fe22-403f-8f6b-e78d773595ca tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:44.778553 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c7ee6f18-fe22-403f-8f6b-e78d773595ca tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:44.778982 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c7ee6f18-fe22-403f-8f6b-e78d773595ca tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:44.783607 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c7ee6f18-fe22-403f-8f6b-e78d773595ca tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:44.786469 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c7ee6f18-fe22-403f-8f6b-e78d773595ca tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:45.160827 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-c7ee6f18-fe22-403f-8f6b-e78d773595ca tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:45.212315 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-c7ee6f18-fe22-403f-8f6b-e78d773595ca tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1232 microversion: 2.1 time: 0.469224 May 26 18:01:45.228089 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 24/41] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:01:44 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1232 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:45.247470 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-8d4e99e7-add7-4b74-9abe-6f7878fc98ba tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:45.248324 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-8d4e99e7-add7-4b74-9abe-6f7878fc98ba tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] [instance: 597e2bca-7106-4c57-9ce3-b73108629960] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:45.280623 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8d4e99e7-add7-4b74-9abe-6f7878fc98ba tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:45.281492 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8d4e99e7-add7-4b74-9abe-6f7878fc98ba tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:45.283410 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8d4e99e7-add7-4b74-9abe-6f7878fc98ba tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:45.284881 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8d4e99e7-add7-4b74-9abe-6f7878fc98ba tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:45.576690 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-8d4e99e7-add7-4b74-9abe-6f7878fc98ba tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caae6984c3b47c59f8b385af0b40f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41aaf61888b149a59ed741d201490e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:45.585873 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-8d4e99e7-add7-4b74-9abe-6f7878fc98ba tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] 10.222.0.69 "GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960" status: 200 len: 1314 microversion: 2.1 time: 0.351965 May 26 18:01:45.592423 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 25/42] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:01:45 2022] GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960 => generated 1314 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:45.760912 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-dbd4441a-6427-441d-9cbd-5fb70e83cbe4 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:45.761843 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-dbd4441a-6427-441d-9cbd-5fb70e83cbe4 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:45.786114 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-dbd4441a-6427-441d-9cbd-5fb70e83cbe4 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:45.786510 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-dbd4441a-6427-441d-9cbd-5fb70e83cbe4 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:45.787481 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-dbd4441a-6427-441d-9cbd-5fb70e83cbe4 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:45.788264 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-dbd4441a-6427-441d-9cbd-5fb70e83cbe4 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:45.860176 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.virt.hardware [None req-c7110c6e-ca05-453b-94c0-8506d689df01 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Flavor limits 0:0:0 {{(pid=117722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:01:45.860758 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.virt.hardware [None req-c7110c6e-ca05-453b-94c0-8506d689df01 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Image limits 0:0:0 {{(pid=117722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:01:45.861420 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.virt.hardware [None req-c7110c6e-ca05-453b-94c0-8506d689df01 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Flavor pref 0:0:0 {{(pid=117722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:01:45.862073 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.virt.hardware [None req-c7110c6e-ca05-453b-94c0-8506d689df01 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Image pref 0:0:0 {{(pid=117722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:01:45.862832 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.virt.hardware [None req-c7110c6e-ca05-453b-94c0-8506d689df01 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:01:45.882736 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_cell0:SELECT=33 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:45.886488 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c7110c6e-ca05-453b-94c0-8506d689df01 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:45.886952 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c7110c6e-ca05-453b-94c0-8506d689df01 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:45.887768 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c7110c6e-ca05-453b-94c0-8506d689df01 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:45.888417 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c7110c6e-ca05-453b-94c0-8506d689df01 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:45.903558 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_cell1:SELECT=59 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:45.915611 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.quota [None req-c7110c6e-ca05-453b-94c0-8506d689df01 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Getting quotas for project 53288d567a8f426bb068908db481e32e. Resources: {'instances', 'ram', 'cores'} {{(pid=117722) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:01:45.924124 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.quota [None req-c7110c6e-ca05-453b-94c0-8506d689df01 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Getting quotas for user 5b5c8dedd274447da8ee4600feb6a26c and project 53288d567a8f426bb068908db481e32e. Resources: {'instances', 'ram', 'cores'} {{(pid=117722) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:01:45.939681 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-c7110c6e-ca05-453b-94c0-8506d689df01 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Going to run 1 instances... {{(pid=117722) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:01:45.944724 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-c7110c6e-ca05-453b-94c0-8506d689df01 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='16351c96-cb02-4711-99d5-fd4d80e8a846',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:01:46.050644 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-c7110c6e-ca05-453b-94c0-8506d689df01 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.106675 May 26 18:01:46.051327 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 18/43] 10.222.0.69 () {60 vars in 1146 bytes} [Thu May 26 18:01:43 2022] POST /compute/v2.1/servers => generated 383 bytes in 2108 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 26 18:01:46.075767 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-5be41940-de15-499e-a8a2-be3e98f6ff3e tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:46.077925 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-5be41940-de15-499e-a8a2-be3e98f6ff3e tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:46.215871 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-5be41940-de15-499e-a8a2-be3e98f6ff3e tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:46.234702 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-5be41940-de15-499e-a8a2-be3e98f6ff3e tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1222 microversion: 2.1 time: 0.173843 May 26 18:01:46.239143 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 19/44] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:01:46 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1222 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:46.255097 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-7dea0fa1-e5b6-4691-95ae-e917ac22b242 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:46.256156 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-7dea0fa1-e5b6-4691-95ae-e917ac22b242 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:46.269301 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7dea0fa1-e5b6-4691-95ae-e917ac22b242 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:46.269976 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7dea0fa1-e5b6-4691-95ae-e917ac22b242 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:46.271996 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7dea0fa1-e5b6-4691-95ae-e917ac22b242 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:46.273202 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7dea0fa1-e5b6-4691-95ae-e917ac22b242 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:46.382285 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-7dea0fa1-e5b6-4691-95ae-e917ac22b242 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:46.417931 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-7dea0fa1-e5b6-4691-95ae-e917ac22b242 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1294 microversion: 2.1 time: 0.173989 May 26 18:01:46.428612 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 20/45] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:01:46 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1294 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:46.610647 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-42ef4555-4355-4534-8fee-02fe954fc0fe tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:46.611295 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-42ef4555-4355-4534-8fee-02fe954fc0fe tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] [instance: 597e2bca-7106-4c57-9ce3-b73108629960] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:46.625608 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-42ef4555-4355-4534-8fee-02fe954fc0fe tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:46.626084 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-42ef4555-4355-4534-8fee-02fe954fc0fe tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:46.626966 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-42ef4555-4355-4534-8fee-02fe954fc0fe tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:46.628255 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-42ef4555-4355-4534-8fee-02fe954fc0fe tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:46.817037 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-dbd4441a-6427-441d-9cbd-5fb70e83cbe4 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:46.834880 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-dbd4441a-6427-441d-9cbd-5fb70e83cbe4 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:46.850474 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-dbd4441a-6427-441d-9cbd-5fb70e83cbe4 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:46.857245 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-dbd4441a-6427-441d-9cbd-5fb70e83cbe4 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1406 microversion: 2.20 time: 1.095805 May 26 18:01:46.864431 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 26/46] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:01:45 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1406 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:01:47.260041 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-8ce5f22b-4a83-4769-9661-c00e126308e3 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:47.261846 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-8ce5f22b-4a83-4769-9661-c00e126308e3 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:47.285120 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8ce5f22b-4a83-4769-9661-c00e126308e3 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:47.288861 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8ce5f22b-4a83-4769-9661-c00e126308e3 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:47.291536 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8ce5f22b-4a83-4769-9661-c00e126308e3 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:47.297130 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8ce5f22b-4a83-4769-9661-c00e126308e3 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:47.438641 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-8ce5f22b-4a83-4769-9661-c00e126308e3 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:47.445515 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-42ef4555-4355-4534-8fee-02fe954fc0fe tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caae6984c3b47c59f8b385af0b40f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41aaf61888b149a59ed741d201490e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:47.447664 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-8ce5f22b-4a83-4769-9661-c00e126308e3 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1274 microversion: 2.1 time: 0.194679 May 26 18:01:47.448288 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 27/47] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:01:47 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1274 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:47.457250 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-fd76bd29-d55a-4b83-9dad-3bc69cd50e55 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:47.457791 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-fd76bd29-d55a-4b83-9dad-3bc69cd50e55 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:47.464457 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-42ef4555-4355-4534-8fee-02fe954fc0fe tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] 10.222.0.69 "GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960" status: 200 len: 1314 microversion: 2.1 time: 0.858303 May 26 18:01:47.465747 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 21/48] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:01:46 2022] GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960 => generated 1314 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:01:47.472102 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fd76bd29-d55a-4b83-9dad-3bc69cd50e55 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:47.473061 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fd76bd29-d55a-4b83-9dad-3bc69cd50e55 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:47.473864 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fd76bd29-d55a-4b83-9dad-3bc69cd50e55 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:47.474326 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fd76bd29-d55a-4b83-9dad-3bc69cd50e55 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:47.676299 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-fd76bd29-d55a-4b83-9dad-3bc69cd50e55 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:47.688599 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-fd76bd29-d55a-4b83-9dad-3bc69cd50e55 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1294 microversion: 2.1 time: 0.236488 May 26 18:01:47.689198 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 28/49] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:01:47 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1294 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:47.877313 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-6a511173-4696-4140-b1ef-d94795556826 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:47.879369 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-6a511173-4696-4140-b1ef-d94795556826 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:47.890110 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-6a511173-4696-4140-b1ef-d94795556826 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:47.892641 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-6a511173-4696-4140-b1ef-d94795556826 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:47.897093 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-6a511173-4696-4140-b1ef-d94795556826 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:47.899253 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-6a511173-4696-4140-b1ef-d94795556826 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:48.465541 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-e83715f9-0efe-4ae6-9e01-30e529bbe6ad tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:48.466329 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-e83715f9-0efe-4ae6-9e01-30e529bbe6ad tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:48.481315 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e83715f9-0efe-4ae6-9e01-30e529bbe6ad tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:48.481773 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e83715f9-0efe-4ae6-9e01-30e529bbe6ad tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:48.490054 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e83715f9-0efe-4ae6-9e01-30e529bbe6ad tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:48.490746 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e83715f9-0efe-4ae6-9e01-30e529bbe6ad tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:48.686972 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-e83715f9-0efe-4ae6-9e01-30e529bbe6ad tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:48.695861 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-e83715f9-0efe-4ae6-9e01-30e529bbe6ad tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1280 microversion: 2.1 time: 0.234798 May 26 18:01:48.715429 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 29/50] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:01:48 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1280 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:48.715429 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-d66df70b-dfff-4d8f-8682-28336bddc5cb tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:48.715429 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-d66df70b-dfff-4d8f-8682-28336bddc5cb tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] [instance: 597e2bca-7106-4c57-9ce3-b73108629960] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:48.761126 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d66df70b-dfff-4d8f-8682-28336bddc5cb tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:48.761822 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d66df70b-dfff-4d8f-8682-28336bddc5cb tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:48.762927 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d66df70b-dfff-4d8f-8682-28336bddc5cb tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:48.765787 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d66df70b-dfff-4d8f-8682-28336bddc5cb tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:49.028330 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-6a511173-4696-4140-b1ef-d94795556826 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:49.043908 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-6a511173-4696-4140-b1ef-d94795556826 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:49.046110 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-6a511173-4696-4140-b1ef-d94795556826 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:49.047429 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-6a511173-4696-4140-b1ef-d94795556826 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1406 microversion: 2.20 time: 1.174086 May 26 18:01:49.056637 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 22/51] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:01:47 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1406 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:01:49.281773 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [req-15571a27-e3d9-4b9f-9893-e02aacc042b3 req-68116e4e-1423-4e22-b8e9-afe329eb8d08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "262a4944-6c10-4122-adce-f7780ff4e7a1", "tag": "0450cfd2-c365-4788-a3b6-a839770208e7"}]} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:01:49.300206 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-15571a27-e3d9-4b9f-9893-e02aacc042b3 req-68116e4e-1423-4e22-b8e9-afe329eb8d08 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:49.300655 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-15571a27-e3d9-4b9f-9893-e02aacc042b3 req-68116e4e-1423-4e22-b8e9-afe329eb8d08 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:49.329661 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.compute.server_external_events [req-15571a27-e3d9-4b9f-9893-e02aacc042b3 req-68116e4e-1423-4e22-b8e9-afe329eb8d08 service nova] Creating event network-changed:0450cfd2-c365-4788-a3b6-a839770208e7 for instance 262a4944-6c10-4122-adce-f7780ff4e7a1 on hv-cinder-83607 May 26 18:01:49.335918 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [req-15571a27-e3d9-4b9f-9893-e02aacc042b3 req-68116e4e-1423-4e22-b8e9-afe329eb8d08 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.277526 May 26 18:01:49.337068 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 23/52] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:01:49.342827 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-07c5100d-bc0b-4f7a-8efb-598b9334c3d6 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:49.343717 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-07c5100d-bc0b-4f7a-8efb-598b9334c3d6 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:49.352404 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-07c5100d-bc0b-4f7a-8efb-598b9334c3d6 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:49.353067 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-07c5100d-bc0b-4f7a-8efb-598b9334c3d6 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:49.370858 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-07c5100d-bc0b-4f7a-8efb-598b9334c3d6 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:49.371763 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-07c5100d-bc0b-4f7a-8efb-598b9334c3d6 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:49.526209 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-d66df70b-dfff-4d8f-8682-28336bddc5cb tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caae6984c3b47c59f8b385af0b40f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41aaf61888b149a59ed741d201490e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:49.538345 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-d66df70b-dfff-4d8f-8682-28336bddc5cb tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] 10.222.0.69 "GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960" status: 200 len: 1314 microversion: 2.1 time: 0.830583 May 26 18:01:49.541367 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 30/53] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:01:48 2022] GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960 => generated 1314 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:49.720468 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-7adae2f4-c22e-4fd3-b949-88b5787a585a req-71ef37c9-5522-494f-a47a-7df1bd5fe3d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "597e2bca-7106-4c57-9ce3-b73108629960", "name": "network-vif-plugged", "status": "completed", "tag": "286236cd-e1bf-4690-8d1b-f843a4d0118f"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:01:49.736563 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-07c5100d-bc0b-4f7a-8efb-598b9334c3d6 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:49.746477 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-7adae2f4-c22e-4fd3-b949-88b5787a585a req-71ef37c9-5522-494f-a47a-7df1bd5fe3d2 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:49.749361 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-7adae2f4-c22e-4fd3-b949-88b5787a585a req-71ef37c9-5522-494f-a47a-7df1bd5fe3d2 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:49.750909 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-07c5100d-bc0b-4f7a-8efb-598b9334c3d6 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1294 microversion: 2.1 time: 0.412305 May 26 18:01:49.760732 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 24/54] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:01:49 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1294 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:49.760732 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-1a138d3a-af8e-4a02-ae20-a8ae00807cf7 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:49.760732 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-1a138d3a-af8e-4a02-ae20-a8ae00807cf7 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:49.765601 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-1a138d3a-af8e-4a02-ae20-a8ae00807cf7 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:49.766136 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-1a138d3a-af8e-4a02-ae20-a8ae00807cf7 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:49.767795 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-1a138d3a-af8e-4a02-ae20-a8ae00807cf7 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:49.769735 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-1a138d3a-af8e-4a02-ae20-a8ae00807cf7 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:49.792661 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=100 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:49.815887 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-7adae2f4-c22e-4fd3-b949-88b5787a585a req-71ef37c9-5522-494f-a47a-7df1bd5fe3d2 service nova] Creating event network-vif-plugged:286236cd-e1bf-4690-8d1b-f843a4d0118f for instance 597e2bca-7106-4c57-9ce3-b73108629960 on hv-cinder-83607 May 26 18:01:49.816556 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-7adae2f4-c22e-4fd3-b949-88b5787a585a req-71ef37c9-5522-494f-a47a-7df1bd5fe3d2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 26 18:01:49.817763 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5d70a035-5edb-4663-85ac-517b51abae43 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:49.818253 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5d70a035-5edb-4663-85ac-517b51abae43 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:49.821729 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5d70a035-5edb-4663-85ac-517b51abae43 None None] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:49.822205 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5d70a035-5edb-4663-85ac-517b51abae43 None None] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:49.835078 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.compute.rpcapi [None req-5d70a035-5edb-4663-85ac-517b51abae43 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 26 18:01:49.835958 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5d70a035-5edb-4663-85ac-517b51abae43 None None] Releasing lock "compute-rpcapi-router" {{(pid=117723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 26 18:01:49.891171 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-5d70a035-5edb-4663-85ac-517b51abae43 None None] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.348146 May 26 18:01:49.892058 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 31/55] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:01:50.079370 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-7b6ffb66-eba2-4dbe-97c1-f26d9d0872f2 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:50.087208 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-7b6ffb66-eba2-4dbe-97c1-f26d9d0872f2 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:50.113512 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7b6ffb66-eba2-4dbe-97c1-f26d9d0872f2 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:50.116237 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7b6ffb66-eba2-4dbe-97c1-f26d9d0872f2 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:50.118535 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7b6ffb66-eba2-4dbe-97c1-f26d9d0872f2 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:50.120428 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7b6ffb66-eba2-4dbe-97c1-f26d9d0872f2 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:50.311879 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-1a138d3a-af8e-4a02-ae20-a8ae00807cf7 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:50.326465 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-1a138d3a-af8e-4a02-ae20-a8ae00807cf7 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1322 microversion: 2.1 time: 0.573261 May 26 18:01:50.332622 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 25/56] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:01:49 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1322 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:50.562590 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-3c52ce61-c5e7-4fc2-9581-837044a9824b tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:50.563676 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-3c52ce61-c5e7-4fc2-9581-837044a9824b tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] [instance: 597e2bca-7106-4c57-9ce3-b73108629960] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:50.572583 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3c52ce61-c5e7-4fc2-9581-837044a9824b tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:50.573408 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3c52ce61-c5e7-4fc2-9581-837044a9824b tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:50.574468 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3c52ce61-c5e7-4fc2-9581-837044a9824b tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:50.575240 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3c52ce61-c5e7-4fc2-9581-837044a9824b tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:50.740092 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-7b6ffb66-eba2-4dbe-97c1-f26d9d0872f2 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:50.754001 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-7b6ffb66-eba2-4dbe-97c1-f26d9d0872f2 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:50.756742 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-7b6ffb66-eba2-4dbe-97c1-f26d9d0872f2 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:50.758004 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-7b6ffb66-eba2-4dbe-97c1-f26d9d0872f2 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1406 microversion: 2.20 time: 0.685921 May 26 18:01:50.790139 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 32/57] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:01:50 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1406 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:01:50.801426 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-7a2e27a4-dd6c-4158-b3b6-c5b554451676 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:50.803050 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-7a2e27a4-dd6c-4158-b3b6-c5b554451676 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:50.819988 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7a2e27a4-dd6c-4158-b3b6-c5b554451676 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:50.820757 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7a2e27a4-dd6c-4158-b3b6-c5b554451676 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:50.822177 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7a2e27a4-dd6c-4158-b3b6-c5b554451676 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:50.826876 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7a2e27a4-dd6c-4158-b3b6-c5b554451676 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:51.035147 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-3c52ce61-c5e7-4fc2-9581-837044a9824b tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caae6984c3b47c59f8b385af0b40f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41aaf61888b149a59ed741d201490e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:51.052396 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-3c52ce61-c5e7-4fc2-9581-837044a9824b tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] 10.222.0.69 "GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960" status: 200 len: 1314 microversion: 2.1 time: 0.495838 May 26 18:01:51.060088 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 26/58] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:01:50 2022] GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960 => generated 1314 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:51.347285 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-6f393c66-ac50-4a2f-adac-e6015bfc9d1f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:51.349262 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-6f393c66-ac50-4a2f-adac-e6015bfc9d1f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:51.357854 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-7a2e27a4-dd6c-4158-b3b6-c5b554451676 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:51.369713 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-6f393c66-ac50-4a2f-adac-e6015bfc9d1f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:51.370113 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-7a2e27a4-dd6c-4158-b3b6-c5b554451676 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1362 microversion: 2.1 time: 0.577641 May 26 18:01:51.380386 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-6f393c66-ac50-4a2f-adac-e6015bfc9d1f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:51.380474 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 33/59] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:01:50 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1362 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:51.380569 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-6f393c66-ac50-4a2f-adac-e6015bfc9d1f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:51.380569 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-6f393c66-ac50-4a2f-adac-e6015bfc9d1f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:51.688807 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-ea39035d-5560-4d49-a419-84c2e0a687d2 req-be069622-d6c1-4704-a2c8-9ac02db7e4be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e617476-1bcd-49f6-b16b-1513445fc759", "tag": "efa3e5cd-83db-40dc-825f-91ed2c94a915"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:01:51.705416 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-ea39035d-5560-4d49-a419-84c2e0a687d2 req-be069622-d6c1-4704-a2c8-9ac02db7e4be service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:51.706791 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-6f393c66-ac50-4a2f-adac-e6015bfc9d1f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:51.707419 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-ea39035d-5560-4d49-a419-84c2e0a687d2 req-be069622-d6c1-4704-a2c8-9ac02db7e4be service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:51.731242 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-ea39035d-5560-4d49-a419-84c2e0a687d2 req-be069622-d6c1-4704-a2c8-9ac02db7e4be service nova] Creating event network-changed:efa3e5cd-83db-40dc-825f-91ed2c94a915 for instance 3e617476-1bcd-49f6-b16b-1513445fc759 on hv-cinder-83607 May 26 18:01:51.735534 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-6f393c66-ac50-4a2f-adac-e6015bfc9d1f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1322 microversion: 2.1 time: 0.394548 May 26 18:01:51.738548 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 27/60] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:01:51 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1322 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:01:51.740558 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-ea39035d-5560-4d49-a419-84c2e0a687d2 req-be069622-d6c1-4704-a2c8-9ac02db7e4be service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057159 May 26 18:01:51.741717 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 34/61] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:01:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:01:51.779693 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-72da1d24-a91f-4a6a-a665-061fb07520e8 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:51.780351 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-72da1d24-a91f-4a6a-a665-061fb07520e8 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:51.793347 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-72da1d24-a91f-4a6a-a665-061fb07520e8 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:51.793813 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-72da1d24-a91f-4a6a-a665-061fb07520e8 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:51.794610 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-72da1d24-a91f-4a6a-a665-061fb07520e8 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:51.798363 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-72da1d24-a91f-4a6a-a665-061fb07520e8 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:52.023418 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-f041ecd1-dec8-472b-a480-4b685141677e req-b665c02b-d32c-4cf0-939d-12e6b8ad6d8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcca8b79-ed51-48fa-85ad-4af0a09f7c20", "tag": "b29d6acf-04aa-4714-90fd-8db0f59d3e5c"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:01:52.048250 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-f041ecd1-dec8-472b-a480-4b685141677e req-b665c02b-d32c-4cf0-939d-12e6b8ad6d8d service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:52.048951 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-f041ecd1-dec8-472b-a480-4b685141677e req-b665c02b-d32c-4cf0-939d-12e6b8ad6d8d service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:52.077831 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-f041ecd1-dec8-472b-a480-4b685141677e req-b665c02b-d32c-4cf0-939d-12e6b8ad6d8d service nova] Creating event network-changed:b29d6acf-04aa-4714-90fd-8db0f59d3e5c for instance bcca8b79-ed51-48fa-85ad-4af0a09f7c20 on hv-cinder-83607 May 26 18:01:52.085464 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-f041ecd1-dec8-472b-a480-4b685141677e req-b665c02b-d32c-4cf0-939d-12e6b8ad6d8d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068507 May 26 18:01:52.086743 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 35/62] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:01:52.095628 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-2ca659cb-0fd2-4d58-ab84-65c9f75025b0 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:52.096624 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-2ca659cb-0fd2-4d58-ab84-65c9f75025b0 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] [instance: 597e2bca-7106-4c57-9ce3-b73108629960] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:52.111657 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2ca659cb-0fd2-4d58-ab84-65c9f75025b0 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:52.112540 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2ca659cb-0fd2-4d58-ab84-65c9f75025b0 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:52.120443 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2ca659cb-0fd2-4d58-ab84-65c9f75025b0 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:52.121596 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2ca659cb-0fd2-4d58-ab84-65c9f75025b0 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:52.141965 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-72da1d24-a91f-4a6a-a665-061fb07520e8 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:52.161356 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-72da1d24-a91f-4a6a-a665-061fb07520e8 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:52.164717 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-72da1d24-a91f-4a6a-a665-061fb07520e8 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:52.168672 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-72da1d24-a91f-4a6a-a665-061fb07520e8 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1406 microversion: 2.20 time: 0.392656 May 26 18:01:52.179861 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 28/63] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:01:51 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1406 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:01:52.389247 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-2ae6858d-0943-4c17-848b-bd6dd0b79d20 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:52.390415 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-2ae6858d-0943-4c17-848b-bd6dd0b79d20 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:52.398340 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-2ae6858d-0943-4c17-848b-bd6dd0b79d20 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:52.399135 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-2ae6858d-0943-4c17-848b-bd6dd0b79d20 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:52.400422 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-2ae6858d-0943-4c17-848b-bd6dd0b79d20 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:52.401109 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-2ae6858d-0943-4c17-848b-bd6dd0b79d20 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:52.600591 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-2ae6858d-0943-4c17-848b-bd6dd0b79d20 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:52.609783 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-2ae6858d-0943-4c17-848b-bd6dd0b79d20 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1362 microversion: 2.1 time: 0.224582 May 26 18:01:52.614930 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 29/64] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:01:52 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1362 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:52.724385 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-2ca659cb-0fd2-4d58-ab84-65c9f75025b0 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caae6984c3b47c59f8b385af0b40f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41aaf61888b149a59ed741d201490e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:52.760721 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-8454c830-2d38-47a4-a18b-05597c5bc97b tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:52.761667 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-8454c830-2d38-47a4-a18b-05597c5bc97b tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:52.779160 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-2ca659cb-0fd2-4d58-ab84-65c9f75025b0 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] 10.222.0.69 "GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960" status: 200 len: 1314 microversion: 2.1 time: 0.655566 May 26 18:01:52.781532 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 36/65] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:01:52 2022] GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960 => generated 1314 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:52.794992 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-8454c830-2d38-47a4-a18b-05597c5bc97b tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:52.796164 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-8454c830-2d38-47a4-a18b-05597c5bc97b tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:52.797953 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-8454c830-2d38-47a4-a18b-05597c5bc97b tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:52.798738 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-8454c830-2d38-47a4-a18b-05597c5bc97b tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:52.975323 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-8454c830-2d38-47a4-a18b-05597c5bc97b tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:52.984864 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-8454c830-2d38-47a4-a18b-05597c5bc97b tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1322 microversion: 2.1 time: 0.233508 May 26 18:01:52.991915 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 30/66] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:01:52 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1322 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:53.198854 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-c06e09fc-2904-4476-a938-8feb94dfe907 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:53.199711 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-c06e09fc-2904-4476-a938-8feb94dfe907 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:53.207500 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c06e09fc-2904-4476-a938-8feb94dfe907 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:53.208209 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c06e09fc-2904-4476-a938-8feb94dfe907 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:53.209157 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c06e09fc-2904-4476-a938-8feb94dfe907 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:53.209754 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c06e09fc-2904-4476-a938-8feb94dfe907 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:53.357437 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell0:SELECT=8 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:53.634997 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-be62deb8-5f6f-4b19-ab38-f3b01d6d2d9c tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:53.636536 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-be62deb8-5f6f-4b19-ab38-f3b01d6d2d9c tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:53.658248 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-be62deb8-5f6f-4b19-ab38-f3b01d6d2d9c tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:53.660941 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-be62deb8-5f6f-4b19-ab38-f3b01d6d2d9c tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:53.683578 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-be62deb8-5f6f-4b19-ab38-f3b01d6d2d9c tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:53.688294 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-be62deb8-5f6f-4b19-ab38-f3b01d6d2d9c tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:54.052833 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-c06e09fc-2904-4476-a938-8feb94dfe907 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:54.061162 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-c06e09fc-2904-4476-a938-8feb94dfe907 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:54.072788 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-c06e09fc-2904-4476-a938-8feb94dfe907 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:54.073985 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-c06e09fc-2904-4476-a938-8feb94dfe907 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1406 microversion: 2.20 time: 0.879232 May 26 18:01:54.085563 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 37/67] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:01:53 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1406 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:01:54.100476 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-ebb121a3-1324-4bf2-bcb5-3b4cf418e4dc tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:54.101488 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-ebb121a3-1324-4bf2-bcb5-3b4cf418e4dc tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] [instance: 597e2bca-7106-4c57-9ce3-b73108629960] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:54.109314 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ebb121a3-1324-4bf2-bcb5-3b4cf418e4dc tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:54.110302 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ebb121a3-1324-4bf2-bcb5-3b4cf418e4dc tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:54.111682 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ebb121a3-1324-4bf2-bcb5-3b4cf418e4dc tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:54.112965 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ebb121a3-1324-4bf2-bcb5-3b4cf418e4dc tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:54.254164 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-be62deb8-5f6f-4b19-ab38-f3b01d6d2d9c tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:54.276215 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-be62deb8-5f6f-4b19-ab38-f3b01d6d2d9c tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1362 microversion: 2.1 time: 0.641735 May 26 18:01:54.276855 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 31/68] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:01:53 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1362 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:01:54.295447 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [req-9240bfd3-d784-4514-af30-ea9fabdb12ac req-c75bbcec-4090-4152-ba0f-f8c2055d8757 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab024be1-042a-4324-9a5e-f66f33a36fc5", "tag": "6e614e89-75f5-41f4-9d8e-dc40ee2870d3"}]} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:01:54.311614 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-9240bfd3-d784-4514-af30-ea9fabdb12ac req-c75bbcec-4090-4152-ba0f-f8c2055d8757 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:54.313097 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-9240bfd3-d784-4514-af30-ea9fabdb12ac req-c75bbcec-4090-4152-ba0f-f8c2055d8757 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:54.344898 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.compute.server_external_events [req-9240bfd3-d784-4514-af30-ea9fabdb12ac req-c75bbcec-4090-4152-ba0f-f8c2055d8757 service nova] Creating event network-changed:6e614e89-75f5-41f4-9d8e-dc40ee2870d3 for instance ab024be1-042a-4324-9a5e-f66f33a36fc5 on hv-cinder-83607 May 26 18:01:54.354415 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [req-9240bfd3-d784-4514-af30-ea9fabdb12ac req-c75bbcec-4090-4152-ba0f-f8c2055d8757 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075922 May 26 18:01:54.356193 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 32/69] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:01:54.371078 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-7cbccc07-d12e-4c68-9bc0-71472586cb8a tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:54.372114 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-7cbccc07-d12e-4c68-9bc0-71472586cb8a tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:54.380529 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7cbccc07-d12e-4c68-9bc0-71472586cb8a tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:54.381163 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7cbccc07-d12e-4c68-9bc0-71472586cb8a tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:54.382295 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7cbccc07-d12e-4c68-9bc0-71472586cb8a tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:54.391320 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7cbccc07-d12e-4c68-9bc0-71472586cb8a tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:54.456398 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-ebb121a3-1324-4bf2-bcb5-3b4cf418e4dc tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caae6984c3b47c59f8b385af0b40f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41aaf61888b149a59ed741d201490e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:54.464558 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-ebb121a3-1324-4bf2-bcb5-3b4cf418e4dc tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] 10.222.0.69 "GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960" status: 200 len: 1314 microversion: 2.1 time: 0.377487 May 26 18:01:54.465141 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 38/70] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:01:54 2022] GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960 => generated 1314 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:54.563356 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-7cbccc07-d12e-4c68-9bc0-71472586cb8a tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:54.579389 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-7cbccc07-d12e-4c68-9bc0-71472586cb8a tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1322 microversion: 2.1 time: 0.214864 May 26 18:01:54.579389 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 33/71] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:01:54 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:55.093364 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-cfa6ff9b-96c0-42c6-bc55-acd55926d817 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:55.094017 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-cfa6ff9b-96c0-42c6-bc55-acd55926d817 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:55.101002 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-cfa6ff9b-96c0-42c6-bc55-acd55926d817 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:55.101579 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-cfa6ff9b-96c0-42c6-bc55-acd55926d817 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:55.102359 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-cfa6ff9b-96c0-42c6-bc55-acd55926d817 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:55.102798 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-cfa6ff9b-96c0-42c6-bc55-acd55926d817 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:55.244505 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-cfa6ff9b-96c0-42c6-bc55-acd55926d817 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:55.252512 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-cfa6ff9b-96c0-42c6-bc55-acd55926d817 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:55.254049 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-cfa6ff9b-96c0-42c6-bc55-acd55926d817 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:55.255161 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-cfa6ff9b-96c0-42c6-bc55-acd55926d817 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1406 microversion: 2.20 time: 0.166015 May 26 18:01:55.255933 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 39/72] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:01:55 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:01:55.294728 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-abee12f9-7953-4d89-9d32-e54fe61b6bd1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:55.295410 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-abee12f9-7953-4d89-9d32-e54fe61b6bd1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:55.302926 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-abee12f9-7953-4d89-9d32-e54fe61b6bd1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:55.303381 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-abee12f9-7953-4d89-9d32-e54fe61b6bd1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:55.304198 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-abee12f9-7953-4d89-9d32-e54fe61b6bd1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:55.304641 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-abee12f9-7953-4d89-9d32-e54fe61b6bd1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:55.477917 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-abee12f9-7953-4d89-9d32-e54fe61b6bd1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:55.481695 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-9ced4c49-b507-475b-a212-35c90c4a9c68 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:55.482307 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-9ced4c49-b507-475b-a212-35c90c4a9c68 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] [instance: 597e2bca-7106-4c57-9ce3-b73108629960] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:55.489433 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-abee12f9-7953-4d89-9d32-e54fe61b6bd1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1362 microversion: 2.1 time: 0.199516 May 26 18:01:55.490342 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 34/73] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:01:55 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1362 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:55.491497 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9ced4c49-b507-475b-a212-35c90c4a9c68 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:55.491964 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9ced4c49-b507-475b-a212-35c90c4a9c68 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:55.492791 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9ced4c49-b507-475b-a212-35c90c4a9c68 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:55.493221 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9ced4c49-b507-475b-a212-35c90c4a9c68 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:55.571307 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [req-a91ecaf7-d74c-45bc-a234-d1db20049344 req-d7709d6e-691a-4e90-8856-3bb8f31c2890 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "262a4944-6c10-4122-adce-f7780ff4e7a1", "name": "network-vif-plugged", "status": "completed", "tag": "0450cfd2-c365-4788-a3b6-a839770208e7"}]} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:01:55.583541 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-a91ecaf7-d74c-45bc-a234-d1db20049344 req-d7709d6e-691a-4e90-8856-3bb8f31c2890 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:55.584192 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-a91ecaf7-d74c-45bc-a234-d1db20049344 req-d7709d6e-691a-4e90-8856-3bb8f31c2890 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:55.607002 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.compute.server_external_events [req-a91ecaf7-d74c-45bc-a234-d1db20049344 req-d7709d6e-691a-4e90-8856-3bb8f31c2890 service nova] Creating event network-vif-plugged:0450cfd2-c365-4788-a3b6-a839770208e7 for instance 262a4944-6c10-4122-adce-f7780ff4e7a1 on hv-cinder-83607 May 26 18:01:55.612311 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [req-a91ecaf7-d74c-45bc-a234-d1db20049344 req-d7709d6e-691a-4e90-8856-3bb8f31c2890 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047165 May 26 18:01:55.613457 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 35/74] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:01:55.623041 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-3b120376-3d2a-4b96-a154-25dc385fa072 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:55.623752 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-3b120376-3d2a-4b96-a154-25dc385fa072 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:55.637053 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3b120376-3d2a-4b96-a154-25dc385fa072 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:55.637842 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3b120376-3d2a-4b96-a154-25dc385fa072 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:55.638768 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3b120376-3d2a-4b96-a154-25dc385fa072 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:55.639522 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3b120376-3d2a-4b96-a154-25dc385fa072 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:55.680085 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-9ced4c49-b507-475b-a212-35c90c4a9c68 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caae6984c3b47c59f8b385af0b40f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41aaf61888b149a59ed741d201490e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:55.687928 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-9ced4c49-b507-475b-a212-35c90c4a9c68 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] 10.222.0.69 "GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960" status: 200 len: 1314 microversion: 2.1 time: 0.210245 May 26 18:01:55.688542 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 40/75] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:01:55 2022] GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:01:55.806529 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-3b120376-3d2a-4b96-a154-25dc385fa072 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:55.814048 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-3b120376-3d2a-4b96-a154-25dc385fa072 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1322 microversion: 2.1 time: 0.199164 May 26 18:01:55.815143 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 36/76] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:01:55 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1322 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:56.273163 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-008b5f67-9c35-4942-9131-b86650245deb tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:56.273798 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-008b5f67-9c35-4942-9131-b86650245deb tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:56.279779 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-008b5f67-9c35-4942-9131-b86650245deb tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:56.280253 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-008b5f67-9c35-4942-9131-b86650245deb tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:56.281017 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-008b5f67-9c35-4942-9131-b86650245deb tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:56.281450 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-008b5f67-9c35-4942-9131-b86650245deb tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:56.418343 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-008b5f67-9c35-4942-9131-b86650245deb tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:56.427715 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-008b5f67-9c35-4942-9131-b86650245deb tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:56.429245 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-008b5f67-9c35-4942-9131-b86650245deb tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:56.430350 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-008b5f67-9c35-4942-9131-b86650245deb tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1406 microversion: 2.20 time: 0.161791 May 26 18:01:56.430927 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 41/77] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:01:56 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:01:56.507660 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-7274c170-3ce6-4c94-a8d1-ddd5893c87b3 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:56.508317 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-7274c170-3ce6-4c94-a8d1-ddd5893c87b3 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:56.510455 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_cell0:SELECT=8 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:56.511140 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_cell0:SELECT=7 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:56.517335 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7274c170-3ce6-4c94-a8d1-ddd5893c87b3 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:56.517826 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7274c170-3ce6-4c94-a8d1-ddd5893c87b3 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:56.518718 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7274c170-3ce6-4c94-a8d1-ddd5893c87b3 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:56.519055 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7274c170-3ce6-4c94-a8d1-ddd5893c87b3 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:56.660727 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-7274c170-3ce6-4c94-a8d1-ddd5893c87b3 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:56.668821 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-7274c170-3ce6-4c94-a8d1-ddd5893c87b3 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1362 microversion: 2.1 time: 0.166736 May 26 18:01:56.669553 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 37/78] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:01:56 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:56.706982 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-a7994003-8331-441d-bb25-20ca752c48f9 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:56.707598 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-a7994003-8331-441d-bb25-20ca752c48f9 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] [instance: 597e2bca-7106-4c57-9ce3-b73108629960] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:56.713994 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a7994003-8331-441d-bb25-20ca752c48f9 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:56.714450 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a7994003-8331-441d-bb25-20ca752c48f9 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:56.715723 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a7994003-8331-441d-bb25-20ca752c48f9 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:56.715723 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a7994003-8331-441d-bb25-20ca752c48f9 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:56.834181 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-1247c1f6-cc22-473c-8812-2d1e6739e664 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:56.834865 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-1247c1f6-cc22-473c-8812-2d1e6739e664 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:56.841217 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-1247c1f6-cc22-473c-8812-2d1e6739e664 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:56.841937 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-1247c1f6-cc22-473c-8812-2d1e6739e664 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:56.842888 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-1247c1f6-cc22-473c-8812-2d1e6739e664 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:56.843500 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-1247c1f6-cc22-473c-8812-2d1e6739e664 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:56.860128 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_cell1:SELECT=100 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:56.871757 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-a7994003-8331-441d-bb25-20ca752c48f9 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caae6984c3b47c59f8b385af0b40f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41aaf61888b149a59ed741d201490e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:56.879807 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-a7994003-8331-441d-bb25-20ca752c48f9 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] 10.222.0.69 "GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960" status: 200 len: 1314 microversion: 2.1 time: 0.177381 May 26 18:01:56.880576 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 42/79] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:01:56 2022] GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:56.996314 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-1247c1f6-cc22-473c-8812-2d1e6739e664 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:57.007304 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-1247c1f6-cc22-473c-8812-2d1e6739e664 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1322 microversion: 2.1 time: 0.177375 May 26 18:01:57.017161 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 38/80] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:01:56 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:01:57.451140 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-fa6b0aa2-47cd-4f20-98b3-e3d0c7d90f8c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:57.451974 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-fa6b0aa2-47cd-4f20-98b3-e3d0c7d90f8c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:57.467146 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fa6b0aa2-47cd-4f20-98b3-e3d0c7d90f8c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:57.468298 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fa6b0aa2-47cd-4f20-98b3-e3d0c7d90f8c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:57.470419 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fa6b0aa2-47cd-4f20-98b3-e3d0c7d90f8c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:57.471609 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fa6b0aa2-47cd-4f20-98b3-e3d0c7d90f8c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:57.695013 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-405b2978-32aa-4e0d-8a87-aa4636cf6277 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:57.695895 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-405b2978-32aa-4e0d-8a87-aa4636cf6277 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:57.703078 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-405b2978-32aa-4e0d-8a87-aa4636cf6277 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:57.704076 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-405b2978-32aa-4e0d-8a87-aa4636cf6277 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:57.706296 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-405b2978-32aa-4e0d-8a87-aa4636cf6277 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:57.707011 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-405b2978-32aa-4e0d-8a87-aa4636cf6277 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:57.903703 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-405b2978-32aa-4e0d-8a87-aa4636cf6277 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:57.923512 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-405b2978-32aa-4e0d-8a87-aa4636cf6277 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1362 microversion: 2.1 time: 0.237994 May 26 18:01:57.925525 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 39/81] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:01:57 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1362 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:57.931729 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-989cfe68-18cd-4d96-9bc8-c0294cc1dc4c tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:57.933582 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-989cfe68-18cd-4d96-9bc8-c0294cc1dc4c tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] [instance: 597e2bca-7106-4c57-9ce3-b73108629960] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:57.942733 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-989cfe68-18cd-4d96-9bc8-c0294cc1dc4c tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:57.943625 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-989cfe68-18cd-4d96-9bc8-c0294cc1dc4c tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:57.944846 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-989cfe68-18cd-4d96-9bc8-c0294cc1dc4c tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:57.945317 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-989cfe68-18cd-4d96-9bc8-c0294cc1dc4c tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:57.985660 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-fa6b0aa2-47cd-4f20-98b3-e3d0c7d90f8c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:57.996348 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-fa6b0aa2-47cd-4f20-98b3-e3d0c7d90f8c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:57.998389 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-fa6b0aa2-47cd-4f20-98b3-e3d0c7d90f8c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:57.999957 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-fa6b0aa2-47cd-4f20-98b3-e3d0c7d90f8c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1406 microversion: 2.20 time: 0.555053 May 26 18:01:58.000578 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 43/82] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:01:57 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1406 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:01:58.026518 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-34f00e6d-e79f-4838-89e6-70b4e53dc35a tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:58.027564 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-34f00e6d-e79f-4838-89e6-70b4e53dc35a tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:58.036058 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-34f00e6d-e79f-4838-89e6-70b4e53dc35a tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:58.036709 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-34f00e6d-e79f-4838-89e6-70b4e53dc35a tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:58.037772 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-34f00e6d-e79f-4838-89e6-70b4e53dc35a tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:58.038406 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-34f00e6d-e79f-4838-89e6-70b4e53dc35a tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:58.122416 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-989cfe68-18cd-4d96-9bc8-c0294cc1dc4c tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caae6984c3b47c59f8b385af0b40f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41aaf61888b149a59ed741d201490e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:58.150221 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-989cfe68-18cd-4d96-9bc8-c0294cc1dc4c tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] 10.222.0.69 "GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960" status: 200 len: 1314 microversion: 2.1 time: 0.222453 May 26 18:01:58.155831 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 40/83] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:01:57 2022] GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:58.272557 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-34f00e6d-e79f-4838-89e6-70b4e53dc35a tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:58.282449 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-34f00e6d-e79f-4838-89e6-70b4e53dc35a tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1322 microversion: 2.1 time: 0.261827 May 26 18:01:58.295059 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 44/84] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:01:58 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1322 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:58.945492 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-97999329-4d1f-48ca-bd6f-37e15eb1d78a tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:58.946374 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-97999329-4d1f-48ca-bd6f-37e15eb1d78a tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:58.954134 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-97999329-4d1f-48ca-bd6f-37e15eb1d78a tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:58.954690 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-97999329-4d1f-48ca-bd6f-37e15eb1d78a tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:58.956818 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-97999329-4d1f-48ca-bd6f-37e15eb1d78a tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:58.957462 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-97999329-4d1f-48ca-bd6f-37e15eb1d78a tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:59.022029 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-c76810c7-9489-44d0-9ec7-d03def385e5e tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:59.023246 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-c76810c7-9489-44d0-9ec7-d03def385e5e tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:59.032844 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c76810c7-9489-44d0-9ec7-d03def385e5e tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:59.033971 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c76810c7-9489-44d0-9ec7-d03def385e5e tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:59.034817 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c76810c7-9489-44d0-9ec7-d03def385e5e tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:59.035964 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c76810c7-9489-44d0-9ec7-d03def385e5e tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:59.184703 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-97999329-4d1f-48ca-bd6f-37e15eb1d78a tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:59.195815 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-97999329-4d1f-48ca-bd6f-37e15eb1d78a tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1362 microversion: 2.1 time: 0.256754 May 26 18:01:59.196820 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 41/85] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:01:58 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1362 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:59.202646 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-35bf3a61-49eb-410f-a9cd-c2e9668e2064 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:59.203791 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-35bf3a61-49eb-410f-a9cd-c2e9668e2064 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] [instance: 597e2bca-7106-4c57-9ce3-b73108629960] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:59.211376 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-35bf3a61-49eb-410f-a9cd-c2e9668e2064 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:59.211868 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-35bf3a61-49eb-410f-a9cd-c2e9668e2064 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:59.213038 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-35bf3a61-49eb-410f-a9cd-c2e9668e2064 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:59.213488 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-35bf3a61-49eb-410f-a9cd-c2e9668e2064 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:59.270053 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-c76810c7-9489-44d0-9ec7-d03def385e5e tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:59.283289 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-c76810c7-9489-44d0-9ec7-d03def385e5e tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:59.286730 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-c76810c7-9489-44d0-9ec7-d03def385e5e tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:59.288318 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-c76810c7-9489-44d0-9ec7-d03def385e5e tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1406 microversion: 2.20 time: 0.271072 May 26 18:01:59.289214 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 45/86] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:01:59 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1406 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:01:59.306117 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-4599a70c-ee44-4eb3-9a02-84152c33ee33 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:59.307021 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-4599a70c-ee44-4eb3-9a02-84152c33ee33 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:59.314554 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4599a70c-ee44-4eb3-9a02-84152c33ee33 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:59.316354 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4599a70c-ee44-4eb3-9a02-84152c33ee33 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:59.317430 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4599a70c-ee44-4eb3-9a02-84152c33ee33 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:59.318119 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4599a70c-ee44-4eb3-9a02-84152c33ee33 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:59.440457 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-35bf3a61-49eb-410f-a9cd-c2e9668e2064 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caae6984c3b47c59f8b385af0b40f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41aaf61888b149a59ed741d201490e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:59.450454 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-35bf3a61-49eb-410f-a9cd-c2e9668e2064 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] 10.222.0.69 "GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960" status: 200 len: 1314 microversion: 2.1 time: 0.252268 May 26 18:01:59.461013 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 42/87] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:01:59 2022] GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:59.535577 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-4599a70c-ee44-4eb3-9a02-84152c33ee33 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:59.544437 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-4599a70c-ee44-4eb3-9a02-84152c33ee33 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1322 microversion: 2.1 time: 0.242708 May 26 18:01:59.546129 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 46/88] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:01:59 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1322 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:00.215757 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-2d7519e2-e348-49eb-bcee-97828ac046de tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:00.216416 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-2d7519e2-e348-49eb-bcee-97828ac046de tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:00.223932 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-2d7519e2-e348-49eb-bcee-97828ac046de tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:00.224443 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-2d7519e2-e348-49eb-bcee-97828ac046de tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:00.225240 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-2d7519e2-e348-49eb-bcee-97828ac046de tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:00.225735 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-2d7519e2-e348-49eb-bcee-97828ac046de tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:00.307377 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-0dffd42d-04c9-4f8a-a8e1-f738e3a71af6 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:00.308057 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-0dffd42d-04c9-4f8a-a8e1-f738e3a71af6 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:00.311789 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell0:SELECT=4 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:00.317129 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0dffd42d-04c9-4f8a-a8e1-f738e3a71af6 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:00.317808 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0dffd42d-04c9-4f8a-a8e1-f738e3a71af6 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:00.318834 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0dffd42d-04c9-4f8a-a8e1-f738e3a71af6 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:00.319298 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0dffd42d-04c9-4f8a-a8e1-f738e3a71af6 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:00.367790 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-2d7519e2-e348-49eb-bcee-97828ac046de tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:00.375983 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-2d7519e2-e348-49eb-bcee-97828ac046de tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1362 microversion: 2.1 time: 0.163943 May 26 18:02:00.387103 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 43/89] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:00 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:00.467812 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-3f848f2a-9408-4b6d-b9eb-8fd2512e5e84 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:00.469068 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-3f848f2a-9408-4b6d-b9eb-8fd2512e5e84 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] [instance: 597e2bca-7106-4c57-9ce3-b73108629960] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:00.475505 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3f848f2a-9408-4b6d-b9eb-8fd2512e5e84 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:00.475986 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3f848f2a-9408-4b6d-b9eb-8fd2512e5e84 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:00.476760 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3f848f2a-9408-4b6d-b9eb-8fd2512e5e84 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:00.477201 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3f848f2a-9408-4b6d-b9eb-8fd2512e5e84 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:00.578504 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-0dffd42d-04c9-4f8a-a8e1-f738e3a71af6 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:00.591652 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-0dffd42d-04c9-4f8a-a8e1-f738e3a71af6 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:00.593343 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-0dffd42d-04c9-4f8a-a8e1-f738e3a71af6 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:00.594602 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-0dffd42d-04c9-4f8a-a8e1-f738e3a71af6 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1406 microversion: 2.20 time: 0.291341 May 26 18:02:00.595331 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 47/90] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:02:00 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1406 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:02:00.600722 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-632c32db-ca7f-43b0-bb51-234f5b43a969 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:00.602532 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-632c32db-ca7f-43b0-bb51-234f5b43a969 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:00.609524 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-632c32db-ca7f-43b0-bb51-234f5b43a969 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:00.610394 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-632c32db-ca7f-43b0-bb51-234f5b43a969 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:00.611929 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-632c32db-ca7f-43b0-bb51-234f5b43a969 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:00.612716 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-632c32db-ca7f-43b0-bb51-234f5b43a969 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:00.660078 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-3f848f2a-9408-4b6d-b9eb-8fd2512e5e84 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caae6984c3b47c59f8b385af0b40f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41aaf61888b149a59ed741d201490e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:00.668115 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-3f848f2a-9408-4b6d-b9eb-8fd2512e5e84 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] 10.222.0.69 "GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960" status: 200 len: 1314 microversion: 2.1 time: 0.204128 May 26 18:02:00.668715 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 44/91] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:00 2022] GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:02:00.846176 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-632c32db-ca7f-43b0-bb51-234f5b43a969 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:00.884961 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-632c32db-ca7f-43b0-bb51-234f5b43a969 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1322 microversion: 2.1 time: 0.280591 May 26 18:02:00.885837 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 48/92] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:00 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1322 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:01.394663 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-e918adae-78a7-48b7-891c-3454b3937caa tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:01.395282 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-e918adae-78a7-48b7-891c-3454b3937caa tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:01.401888 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e918adae-78a7-48b7-891c-3454b3937caa tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:01.403174 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e918adae-78a7-48b7-891c-3454b3937caa tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:01.403978 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e918adae-78a7-48b7-891c-3454b3937caa tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:01.404456 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e918adae-78a7-48b7-891c-3454b3937caa tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:01.587856 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-e918adae-78a7-48b7-891c-3454b3937caa tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:01.604848 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-e918adae-78a7-48b7-891c-3454b3937caa tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1362 microversion: 2.1 time: 0.214381 May 26 18:02:01.606301 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 45/93] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:01 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1362 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:01.621812 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-8ec90406-b50d-4c18-91ef-44e0bbbf6f7d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:01.623859 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-8ec90406-b50d-4c18-91ef-44e0bbbf6f7d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:01.635014 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8ec90406-b50d-4c18-91ef-44e0bbbf6f7d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:01.635582 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8ec90406-b50d-4c18-91ef-44e0bbbf6f7d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:01.636626 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8ec90406-b50d-4c18-91ef-44e0bbbf6f7d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:01.637260 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8ec90406-b50d-4c18-91ef-44e0bbbf6f7d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:01.665551 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=100 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:01.686559 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-45c65090-9dbd-4486-ad4c-dd7ba927acd7 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:01.687195 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-45c65090-9dbd-4486-ad4c-dd7ba927acd7 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] [instance: 597e2bca-7106-4c57-9ce3-b73108629960] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:01.694550 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-45c65090-9dbd-4486-ad4c-dd7ba927acd7 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:01.694828 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-45c65090-9dbd-4486-ad4c-dd7ba927acd7 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:01.695623 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-45c65090-9dbd-4486-ad4c-dd7ba927acd7 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:01.696151 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-45c65090-9dbd-4486-ad4c-dd7ba927acd7 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:01.871709 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-8ec90406-b50d-4c18-91ef-44e0bbbf6f7d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:01.891458 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-8ec90406-b50d-4c18-91ef-44e0bbbf6f7d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:01.900277 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-8ec90406-b50d-4c18-91ef-44e0bbbf6f7d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:01.903376 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-8ec90406-b50d-4c18-91ef-44e0bbbf6f7d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1598 microversion: 2.20 time: 0.289698 May 26 18:02:01.905658 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 49/94] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:02:01 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1598 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:02:01.915203 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-fa7ebf64-c682-48c8-a647-b9c22357ed1b tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:01.916419 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-fa7ebf64-c682-48c8-a647-b9c22357ed1b tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:01.933756 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fa7ebf64-c682-48c8-a647-b9c22357ed1b tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:01.934971 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fa7ebf64-c682-48c8-a647-b9c22357ed1b tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:01.935960 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fa7ebf64-c682-48c8-a647-b9c22357ed1b tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:01.936557 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fa7ebf64-c682-48c8-a647-b9c22357ed1b tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:01.951764 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-45c65090-9dbd-4486-ad4c-dd7ba927acd7 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caae6984c3b47c59f8b385af0b40f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41aaf61888b149a59ed741d201490e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:01.961196 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-45c65090-9dbd-4486-ad4c-dd7ba927acd7 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] 10.222.0.69 "GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960" status: 200 len: 1501 microversion: 2.1 time: 0.278283 May 26 18:02:01.963448 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 46/95] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:01 2022] GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960 => generated 1501 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:02:01.969568 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-2eaf615e-b94b-4858-9fab-6fe58429b712 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:01.970123 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-2eaf615e-b94b-4858-9fab-6fe58429b712 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:01.980846 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-2eaf615e-b94b-4858-9fab-6fe58429b712 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:01.981276 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-2eaf615e-b94b-4858-9fab-6fe58429b712 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:01.990467 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-2eaf615e-b94b-4858-9fab-6fe58429b712 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:01.990972 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-2eaf615e-b94b-4858-9fab-6fe58429b712 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:02.159848 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-2eaf615e-b94b-4858-9fab-6fe58429b712 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.194899 May 26 18:02:02.167591 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 47/96] 10.222.0.69 () {60 vars in 1315 bytes} [Thu May 26 18:02:01 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1/os-interface => generated 284 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 18:02:02.211742 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-fa7ebf64-c682-48c8-a647-b9c22357ed1b tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:02.229974 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-fa7ebf64-c682-48c8-a647-b9c22357ed1b tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1322 microversion: 2.1 time: 0.321678 May 26 18:02:02.231176 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 50/97] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:01 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1322 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:02.625223 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-290deba4-1ce1-4214-8456-ff0e4ccbc4c1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:02.626656 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-290deba4-1ce1-4214-8456-ff0e4ccbc4c1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:02.636004 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-290deba4-1ce1-4214-8456-ff0e4ccbc4c1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:02.636490 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-290deba4-1ce1-4214-8456-ff0e4ccbc4c1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:02.638364 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-290deba4-1ce1-4214-8456-ff0e4ccbc4c1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:02.638824 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-290deba4-1ce1-4214-8456-ff0e4ccbc4c1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:03.133452 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-290deba4-1ce1-4214-8456-ff0e4ccbc4c1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:03.183067 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-290deba4-1ce1-4214-8456-ff0e4ccbc4c1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1362 microversion: 2.1 time: 0.562951 May 26 18:02:03.189011 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 48/98] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:02 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1362 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:03.257523 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-5a5aa8a9-79e0-4b3e-9986-f32356b09400 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:03.259275 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-5a5aa8a9-79e0-4b3e-9986-f32356b09400 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:03.287975 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5a5aa8a9-79e0-4b3e-9986-f32356b09400 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:03.290728 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5a5aa8a9-79e0-4b3e-9986-f32356b09400 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:03.292382 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5a5aa8a9-79e0-4b3e-9986-f32356b09400 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:03.295384 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5a5aa8a9-79e0-4b3e-9986-f32356b09400 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:03.630157 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-5a5aa8a9-79e0-4b3e-9986-f32356b09400 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:03.652267 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-5a5aa8a9-79e0-4b3e-9986-f32356b09400 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1322 microversion: 2.1 time: 0.399708 May 26 18:02:03.654092 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 51/99] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:03 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1322 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:02:03.696854 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-724f4c4f-8919-4728-8aab-618b745cb87c tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bb9edce4-93bb-4f13-8af9-0a7f18ae9975"}} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:02:03.698116 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-724f4c4f-8919-4728-8aab-618b745cb87c tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] [instance: 597e2bca-7106-4c57-9ce3-b73108629960] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:03.707893 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-724f4c4f-8919-4728-8aab-618b745cb87c tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:03.712362 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-724f4c4f-8919-4728-8aab-618b745cb87c tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:03.716980 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-724f4c4f-8919-4728-8aab-618b745cb87c tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:03.717385 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-724f4c4f-8919-4728-8aab-618b745cb87c tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:04.206605 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-8673559d-3dea-4288-a39d-dd38ec5657d1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:04.208406 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-8673559d-3dea-4288-a39d-dd38ec5657d1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:04.246044 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8673559d-3dea-4288-a39d-dd38ec5657d1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:04.248591 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8673559d-3dea-4288-a39d-dd38ec5657d1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:04.249546 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8673559d-3dea-4288-a39d-dd38ec5657d1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:04.252802 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8673559d-3dea-4288-a39d-dd38ec5657d1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:04.533921 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-724f4c4f-8919-4728-8aab-618b745cb87c tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] 10.222.0.69 "POST /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.843613 May 26 18:02:04.541438 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 49/100] 10.222.0.69 () {60 vars in 1322 bytes} [Thu May 26 18:02:03 2022] POST /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960/os-volume_attachments => generated 194 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:02:04.663113 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [req-1748e96c-bb26-4c2a-8b0c-b892daeb21b9 req-a4c99bc2-81e6-47ed-b409-953b4777f3c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "262a4944-6c10-4122-adce-f7780ff4e7a1", "tag": "0450cfd2-c365-4788-a3b6-a839770208e7"}]} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:02:04.676241 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-1748e96c-bb26-4c2a-8b0c-b892daeb21b9 req-a4c99bc2-81e6-47ed-b409-953b4777f3c2 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:04.676688 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-1748e96c-bb26-4c2a-8b0c-b892daeb21b9 req-a4c99bc2-81e6-47ed-b409-953b4777f3c2 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:04.691092 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.compute.server_external_events [req-1748e96c-bb26-4c2a-8b0c-b892daeb21b9 req-a4c99bc2-81e6-47ed-b409-953b4777f3c2 service nova] Creating event network-changed:0450cfd2-c365-4788-a3b6-a839770208e7 for instance 262a4944-6c10-4122-adce-f7780ff4e7a1 on hv-cinder-83607 May 26 18:02:04.697942 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [req-1748e96c-bb26-4c2a-8b0c-b892daeb21b9 req-a4c99bc2-81e6-47ed-b409-953b4777f3c2 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040249 May 26 18:02:04.705008 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 50/101] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:02:04.712833 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-c470e5ed-e0f6-4ced-be3b-62eddbe63aa7 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:04.714595 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-c470e5ed-e0f6-4ced-be3b-62eddbe63aa7 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:04.742636 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c470e5ed-e0f6-4ced-be3b-62eddbe63aa7 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:04.743623 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c470e5ed-e0f6-4ced-be3b-62eddbe63aa7 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:04.745815 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c470e5ed-e0f6-4ced-be3b-62eddbe63aa7 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:04.747201 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c470e5ed-e0f6-4ced-be3b-62eddbe63aa7 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:04.915942 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-8673559d-3dea-4288-a39d-dd38ec5657d1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:04.936233 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-8673559d-3dea-4288-a39d-dd38ec5657d1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1362 microversion: 2.1 time: 0.724814 May 26 18:02:04.937307 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 52/102] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:04 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1362 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:05.181383 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-c470e5ed-e0f6-4ced-be3b-62eddbe63aa7 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:05.198467 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-c470e5ed-e0f6-4ced-be3b-62eddbe63aa7 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1322 microversion: 2.1 time: 0.491530 May 26 18:02:05.199214 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 51/103] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:04 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1322 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:05.675258 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-5d537582-2fbb-4421-b19d-afd41da121a4 req-b8409394-5598-4fe8-a379-80979c200926 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab024be1-042a-4324-9a5e-f66f33a36fc5", "name": "network-vif-plugged", "status": "completed", "tag": "6e614e89-75f5-41f4-9d8e-dc40ee2870d3"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:02:05.693234 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-5d537582-2fbb-4421-b19d-afd41da121a4 req-b8409394-5598-4fe8-a379-80979c200926 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:05.693873 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-5d537582-2fbb-4421-b19d-afd41da121a4 req-b8409394-5598-4fe8-a379-80979c200926 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:05.715898 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-5d537582-2fbb-4421-b19d-afd41da121a4 req-b8409394-5598-4fe8-a379-80979c200926 service nova] Creating event network-vif-plugged:6e614e89-75f5-41f4-9d8e-dc40ee2870d3 for instance ab024be1-042a-4324-9a5e-f66f33a36fc5 on hv-cinder-83607 May 26 18:02:05.721600 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-5d537582-2fbb-4421-b19d-afd41da121a4 req-b8409394-5598-4fe8-a379-80979c200926 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050519 May 26 18:02:05.722513 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 53/104] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:02:05.954229 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-45ed9db1-592c-44ab-95a8-bd3ce02d9658 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:05.955397 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-45ed9db1-592c-44ab-95a8-bd3ce02d9658 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:05.961941 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-45ed9db1-592c-44ab-95a8-bd3ce02d9658 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:05.962400 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-45ed9db1-592c-44ab-95a8-bd3ce02d9658 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:05.963193 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-45ed9db1-592c-44ab-95a8-bd3ce02d9658 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:05.963642 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-45ed9db1-592c-44ab-95a8-bd3ce02d9658 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:06.119900 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-45ed9db1-592c-44ab-95a8-bd3ce02d9658 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:06.129194 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-45ed9db1-592c-44ab-95a8-bd3ce02d9658 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1362 microversion: 2.1 time: 0.178763 May 26 18:02:06.129788 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 52/105] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:05 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:06.219550 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-111677fa-a455-4948-bc3e-e3032b77c1c5 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:06.220355 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-111677fa-a455-4948-bc3e-e3032b77c1c5 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:06.230036 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-111677fa-a455-4948-bc3e-e3032b77c1c5 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:06.230485 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-111677fa-a455-4948-bc3e-e3032b77c1c5 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:06.231258 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-111677fa-a455-4948-bc3e-e3032b77c1c5 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:06.231692 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-111677fa-a455-4948-bc3e-e3032b77c1c5 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:06.387729 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-111677fa-a455-4948-bc3e-e3032b77c1c5 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:06.400380 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-111677fa-a455-4948-bc3e-e3032b77c1c5 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1322 microversion: 2.1 time: 0.186581 May 26 18:02:06.401116 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 54/106] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:06 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:07.148448 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-f138aa98-d573-4355-bcab-e8196d9a9c95 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:07.149369 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-f138aa98-d573-4355-bcab-e8196d9a9c95 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:07.156644 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-f138aa98-d573-4355-bcab-e8196d9a9c95 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:07.157041 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-f138aa98-d573-4355-bcab-e8196d9a9c95 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:07.158424 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-f138aa98-d573-4355-bcab-e8196d9a9c95 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:07.159070 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-f138aa98-d573-4355-bcab-e8196d9a9c95 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:07.306090 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-f138aa98-d573-4355-bcab-e8196d9a9c95 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:07.313588 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-f138aa98-d573-4355-bcab-e8196d9a9c95 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1362 microversion: 2.1 time: 0.170029 May 26 18:02:07.314327 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 53/107] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:07 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:07.418288 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-265b3a40-340a-480c-8b52-e88f7769694a tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:07.418996 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-265b3a40-340a-480c-8b52-e88f7769694a tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:07.425470 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-265b3a40-340a-480c-8b52-e88f7769694a tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:07.425910 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-265b3a40-340a-480c-8b52-e88f7769694a tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:07.426678 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-265b3a40-340a-480c-8b52-e88f7769694a tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:07.427107 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-265b3a40-340a-480c-8b52-e88f7769694a tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:07.570894 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-265b3a40-340a-480c-8b52-e88f7769694a tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:07.583808 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-265b3a40-340a-480c-8b52-e88f7769694a tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1322 microversion: 2.1 time: 0.169306 May 26 18:02:07.584772 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 55/108] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:07 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:08.333362 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-71278a14-4bfa-4f97-81b1-a37f5854bd20 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:08.334516 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-71278a14-4bfa-4f97-81b1-a37f5854bd20 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:08.341674 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-71278a14-4bfa-4f97-81b1-a37f5854bd20 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:08.342342 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-71278a14-4bfa-4f97-81b1-a37f5854bd20 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:08.343140 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-71278a14-4bfa-4f97-81b1-a37f5854bd20 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:08.343581 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-71278a14-4bfa-4f97-81b1-a37f5854bd20 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:08.489757 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-71278a14-4bfa-4f97-81b1-a37f5854bd20 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:08.492511 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:08.499763 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-71278a14-4bfa-4f97-81b1-a37f5854bd20 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1362 microversion: 2.1 time: 0.171803 May 26 18:02:08.500458 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 54/109] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:08 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:02:08.605264 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-ebc42c5f-a94d-4300-bd54-c00ae4e62fe2 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:08.606202 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-ebc42c5f-a94d-4300-bd54-c00ae4e62fe2 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:08.613669 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ebc42c5f-a94d-4300-bd54-c00ae4e62fe2 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:08.614416 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ebc42c5f-a94d-4300-bd54-c00ae4e62fe2 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:08.615141 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ebc42c5f-a94d-4300-bd54-c00ae4e62fe2 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:08.615600 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ebc42c5f-a94d-4300-bd54-c00ae4e62fe2 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:08.951539 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-ebc42c5f-a94d-4300-bd54-c00ae4e62fe2 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:08.960187 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-ebc42c5f-a94d-4300-bd54-c00ae4e62fe2 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1322 microversion: 2.1 time: 0.359173 May 26 18:02:08.960780 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 56/110] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:08 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1322 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:09.518404 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-add696a9-7672-445d-97e9-41a20adc16db tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:09.519284 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-add696a9-7672-445d-97e9-41a20adc16db tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:09.528970 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-add696a9-7672-445d-97e9-41a20adc16db tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:09.529418 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-add696a9-7672-445d-97e9-41a20adc16db tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:09.530187 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-add696a9-7672-445d-97e9-41a20adc16db tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:09.530649 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-add696a9-7672-445d-97e9-41a20adc16db tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:09.678813 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-add696a9-7672-445d-97e9-41a20adc16db tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:09.689746 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-add696a9-7672-445d-97e9-41a20adc16db tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1362 microversion: 2.1 time: 0.176333 May 26 18:02:09.690358 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 55/111] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:09 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:09.977492 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-a1846239-0fa5-4f8f-bf43-7345bce6715f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:09.978157 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-a1846239-0fa5-4f8f-bf43-7345bce6715f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:09.984673 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a1846239-0fa5-4f8f-bf43-7345bce6715f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:09.985119 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a1846239-0fa5-4f8f-bf43-7345bce6715f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:09.987033 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a1846239-0fa5-4f8f-bf43-7345bce6715f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:09.987480 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a1846239-0fa5-4f8f-bf43-7345bce6715f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:10.131535 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-a1846239-0fa5-4f8f-bf43-7345bce6715f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:10.140788 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-a1846239-0fa5-4f8f-bf43-7345bce6715f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1322 microversion: 2.1 time: 0.167246 May 26 18:02:10.141529 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 57/112] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:09 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:10.707412 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-94e5d454-e1c6-436e-ab18-a9eb0d1a9e0f tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:10.708094 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-94e5d454-e1c6-436e-ab18-a9eb0d1a9e0f tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:10.711505 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:10.715598 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-94e5d454-e1c6-436e-ab18-a9eb0d1a9e0f tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:10.716576 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-94e5d454-e1c6-436e-ab18-a9eb0d1a9e0f tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:10.716989 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-94e5d454-e1c6-436e-ab18-a9eb0d1a9e0f tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:10.717414 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-94e5d454-e1c6-436e-ab18-a9eb0d1a9e0f tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:10.849703 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-94e5d454-e1c6-436e-ab18-a9eb0d1a9e0f tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:10.857701 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-94e5d454-e1c6-436e-ab18-a9eb0d1a9e0f tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1362 microversion: 2.1 time: 0.154971 May 26 18:02:10.858564 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 56/113] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:10 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:11.166002 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-ab0100ac-9bfa-477d-9422-6677cee7caac tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:11.171375 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-ab0100ac-9bfa-477d-9422-6677cee7caac tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:11.182371 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ab0100ac-9bfa-477d-9422-6677cee7caac tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:11.183285 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ab0100ac-9bfa-477d-9422-6677cee7caac tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:11.185426 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ab0100ac-9bfa-477d-9422-6677cee7caac tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:11.186476 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ab0100ac-9bfa-477d-9422-6677cee7caac tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:11.376728 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-ab0100ac-9bfa-477d-9422-6677cee7caac tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:11.384707 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-ab0100ac-9bfa-477d-9422-6677cee7caac tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1322 microversion: 2.1 time: 0.227257 May 26 18:02:11.385243 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 58/114] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:11 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:11.607360 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [req-334fc07d-c923-468f-913c-f978d3f9ca8f req-eb1673a2-d0f0-4ee8-b8db-03db2a9a54c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e617476-1bcd-49f6-b16b-1513445fc759", "name": "network-vif-plugged", "status": "completed", "tag": "efa3e5cd-83db-40dc-825f-91ed2c94a915"}]} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:02:11.623628 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-334fc07d-c923-468f-913c-f978d3f9ca8f req-eb1673a2-d0f0-4ee8-b8db-03db2a9a54c2 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:11.624622 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-334fc07d-c923-468f-913c-f978d3f9ca8f req-eb1673a2-d0f0-4ee8-b8db-03db2a9a54c2 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:11.638947 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.compute.server_external_events [req-334fc07d-c923-468f-913c-f978d3f9ca8f req-eb1673a2-d0f0-4ee8-b8db-03db2a9a54c2 service nova] Creating event network-vif-plugged:efa3e5cd-83db-40dc-825f-91ed2c94a915 for instance 3e617476-1bcd-49f6-b16b-1513445fc759 on hv-cinder-83607 May 26 18:02:11.650303 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [req-334fc07d-c923-468f-913c-f978d3f9ca8f req-eb1673a2-d0f0-4ee8-b8db-03db2a9a54c2 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047408 May 26 18:02:11.651634 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 57/115] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:02:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:02:11.875749 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-aa82cd71-52e0-4bd8-8e93-8069ea6aed01 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:11.877134 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-aa82cd71-52e0-4bd8-8e93-8069ea6aed01 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:11.883894 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-aa82cd71-52e0-4bd8-8e93-8069ea6aed01 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:11.884416 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-aa82cd71-52e0-4bd8-8e93-8069ea6aed01 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:11.885198 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-aa82cd71-52e0-4bd8-8e93-8069ea6aed01 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:11.885635 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-aa82cd71-52e0-4bd8-8e93-8069ea6aed01 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:12.069474 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-aa82cd71-52e0-4bd8-8e93-8069ea6aed01 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:12.077290 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-aa82cd71-52e0-4bd8-8e93-8069ea6aed01 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1362 microversion: 2.1 time: 0.206374 May 26 18:02:12.077868 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 59/116] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:11 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1362 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:12.403028 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-9e384049-e196-483e-9d70-7b188071cc66 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:12.404405 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-9e384049-e196-483e-9d70-7b188071cc66 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:12.414027 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-9e384049-e196-483e-9d70-7b188071cc66 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:12.414804 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-9e384049-e196-483e-9d70-7b188071cc66 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:12.417586 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-9e384049-e196-483e-9d70-7b188071cc66 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:12.418266 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-9e384049-e196-483e-9d70-7b188071cc66 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:12.651191 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-9e384049-e196-483e-9d70-7b188071cc66 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:12.664809 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-9e384049-e196-483e-9d70-7b188071cc66 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1322 microversion: 2.1 time: 0.265500 May 26 18:02:12.666527 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 58/117] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:12 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1322 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:13.095941 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-10aec4cc-a0e7-48a3-b2e5-6443288bdfea tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:13.096774 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-10aec4cc-a0e7-48a3-b2e5-6443288bdfea tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:13.103395 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-10aec4cc-a0e7-48a3-b2e5-6443288bdfea tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:13.104303 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-10aec4cc-a0e7-48a3-b2e5-6443288bdfea tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:13.105330 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-10aec4cc-a0e7-48a3-b2e5-6443288bdfea tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:13.116899 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-10aec4cc-a0e7-48a3-b2e5-6443288bdfea tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:13.476632 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-10aec4cc-a0e7-48a3-b2e5-6443288bdfea tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:13.484881 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-10aec4cc-a0e7-48a3-b2e5-6443288bdfea tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1362 microversion: 2.1 time: 0.393865 May 26 18:02:13.487040 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 60/118] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:13 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1362 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:13.689961 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-792d3bfc-6be9-4b3b-bbe0-32b14852c4ba tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:13.692571 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-792d3bfc-6be9-4b3b-bbe0-32b14852c4ba tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:13.702452 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-792d3bfc-6be9-4b3b-bbe0-32b14852c4ba tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:13.703405 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-792d3bfc-6be9-4b3b-bbe0-32b14852c4ba tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:13.705450 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-792d3bfc-6be9-4b3b-bbe0-32b14852c4ba tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:13.706234 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-792d3bfc-6be9-4b3b-bbe0-32b14852c4ba tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:13.910346 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-792d3bfc-6be9-4b3b-bbe0-32b14852c4ba tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:13.919158 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-792d3bfc-6be9-4b3b-bbe0-32b14852c4ba tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1322 microversion: 2.1 time: 0.237798 May 26 18:02:13.924826 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 59/119] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:13 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1322 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:14.507605 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-86333259-b32d-447b-9ffb-0a48dfe8e930 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:14.508878 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-86333259-b32d-447b-9ffb-0a48dfe8e930 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:14.513156 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:14.521679 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-86333259-b32d-447b-9ffb-0a48dfe8e930 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:14.522476 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-86333259-b32d-447b-9ffb-0a48dfe8e930 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:14.524211 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-86333259-b32d-447b-9ffb-0a48dfe8e930 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:14.524847 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-86333259-b32d-447b-9ffb-0a48dfe8e930 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:14.759064 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-86333259-b32d-447b-9ffb-0a48dfe8e930 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:14.775965 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-86333259-b32d-447b-9ffb-0a48dfe8e930 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1362 microversion: 2.1 time: 0.274806 May 26 18:02:14.784053 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 61/120] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:14 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1362 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:14.941303 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-db55c701-4caa-458e-9dea-4855ac36ed90 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:14.941910 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-db55c701-4caa-458e-9dea-4855ac36ed90 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:14.949148 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-db55c701-4caa-458e-9dea-4855ac36ed90 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:14.949623 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-db55c701-4caa-458e-9dea-4855ac36ed90 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:14.950394 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-db55c701-4caa-458e-9dea-4855ac36ed90 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:14.951002 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-db55c701-4caa-458e-9dea-4855ac36ed90 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:15.116165 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-db55c701-4caa-458e-9dea-4855ac36ed90 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:15.134235 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-db55c701-4caa-458e-9dea-4855ac36ed90 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1516 microversion: 2.1 time: 0.197869 May 26 18:02:15.134833 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 60/121] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:14 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1516 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:15.152605 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-b9dcd031-0c24-4310-837d-6a2907441acb tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:02:15.153757 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-b9dcd031-0c24-4310-837d-6a2907441acb tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:15.162128 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b9dcd031-0c24-4310-837d-6a2907441acb tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:15.162702 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b9dcd031-0c24-4310-837d-6a2907441acb tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:15.163696 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b9dcd031-0c24-4310-837d-6a2907441acb tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:15.164543 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b9dcd031-0c24-4310-837d-6a2907441acb tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:15.231962 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.objects.instance [None req-b9dcd031-0c24-4310-837d-6a2907441acb tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lazy-loading 'flavor' on Instance uuid ab024be1-042a-4324-9a5e-f66f33a36fc5 {{(pid=117723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:02:15.400345 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-b9dcd031-0c24-4310-837d-6a2907441acb tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "POST /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5/action" status: 200 len: 32 microversion: 2.1 time: 0.252047 May 26 18:02:15.403103 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 62/122] 10.222.0.69 () {60 vars in 1277 bytes} [Thu May 26 18:02:15 2022] POST /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5/action => generated 32 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 18:02:15.415548 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-bd9f89e9-0286-49ad-a20c-c352eea6c875 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:15.415656 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-bd9f89e9-0286-49ad-a20c-c352eea6c875 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:15.429907 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-bd9f89e9-0286-49ad-a20c-c352eea6c875 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:15.430413 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-bd9f89e9-0286-49ad-a20c-c352eea6c875 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:15.433154 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-bd9f89e9-0286-49ad-a20c-c352eea6c875 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:15.433747 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-bd9f89e9-0286-49ad-a20c-c352eea6c875 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:15.672662 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-bd9f89e9-0286-49ad-a20c-c352eea6c875 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:15.682913 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-bd9f89e9-0286-49ad-a20c-c352eea6c875 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1522 microversion: 2.1 time: 0.272971 May 26 18:02:15.684192 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 61/123] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:15 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:15.794876 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-633963e4-d10c-4f22-beb3-7a8a64a76b47 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:15.796805 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-633963e4-d10c-4f22-beb3-7a8a64a76b47 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:15.803918 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-633963e4-d10c-4f22-beb3-7a8a64a76b47 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:15.804600 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-633963e4-d10c-4f22-beb3-7a8a64a76b47 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:15.805554 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-633963e4-d10c-4f22-beb3-7a8a64a76b47 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:15.806008 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-633963e4-d10c-4f22-beb3-7a8a64a76b47 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:15.847943 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [req-ed9eb128-2988-4807-b670-8698a85de93f req-82a7f8bb-e1e8-4638-9cfc-c6161cc21205 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcca8b79-ed51-48fa-85ad-4af0a09f7c20", "name": "network-vif-plugged", "status": "completed", "tag": "b29d6acf-04aa-4714-90fd-8db0f59d3e5c"}]} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:02:15.870876 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-ed9eb128-2988-4807-b670-8698a85de93f req-82a7f8bb-e1e8-4638-9cfc-c6161cc21205 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:15.871357 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-ed9eb128-2988-4807-b670-8698a85de93f req-82a7f8bb-e1e8-4638-9cfc-c6161cc21205 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:15.885332 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.compute.server_external_events [req-ed9eb128-2988-4807-b670-8698a85de93f req-82a7f8bb-e1e8-4638-9cfc-c6161cc21205 service nova] Creating event network-vif-plugged:b29d6acf-04aa-4714-90fd-8db0f59d3e5c for instance bcca8b79-ed51-48fa-85ad-4af0a09f7c20 on hv-cinder-83607 May 26 18:02:15.891350 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [req-ed9eb128-2988-4807-b670-8698a85de93f req-82a7f8bb-e1e8-4638-9cfc-c6161cc21205 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049671 May 26 18:02:15.892870 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 62/124] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:02:16.406725 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-633963e4-d10c-4f22-beb3-7a8a64a76b47 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:16.416610 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-633963e4-d10c-4f22-beb3-7a8a64a76b47 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1362 microversion: 2.1 time: 0.626300 May 26 18:02:16.417203 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 63/125] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:15 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1362 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:16.703919 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-69241965-e748-49ff-8db2-95b56accef8b tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:16.705315 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-69241965-e748-49ff-8db2-95b56accef8b tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:16.725057 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-69241965-e748-49ff-8db2-95b56accef8b tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:16.725751 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-69241965-e748-49ff-8db2-95b56accef8b tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:16.727260 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-69241965-e748-49ff-8db2-95b56accef8b tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:16.727931 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-69241965-e748-49ff-8db2-95b56accef8b tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:17.030853 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-69241965-e748-49ff-8db2-95b56accef8b tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:17.051339 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-69241965-e748-49ff-8db2-95b56accef8b tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1522 microversion: 2.1 time: 0.353548 May 26 18:02:17.061906 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 63/126] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:16 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1522 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:17.434194 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-e8f30154-4312-4478-97ac-1ebe94f7c964 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:17.435383 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-e8f30154-4312-4478-97ac-1ebe94f7c964 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:17.444674 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e8f30154-4312-4478-97ac-1ebe94f7c964 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:17.445478 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e8f30154-4312-4478-97ac-1ebe94f7c964 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:17.446819 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e8f30154-4312-4478-97ac-1ebe94f7c964 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:17.447887 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e8f30154-4312-4478-97ac-1ebe94f7c964 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:17.630039 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-e8f30154-4312-4478-97ac-1ebe94f7c964 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:17.633655 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:17.647277 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-e8f30154-4312-4478-97ac-1ebe94f7c964 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1362 microversion: 2.1 time: 0.216533 May 26 18:02:17.647883 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 64/127] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:17 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1362 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:02:18.069826 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-8d770b44-715b-4cb2-b0ff-af187ccd33b3 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:18.071415 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-8d770b44-715b-4cb2-b0ff-af187ccd33b3 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:18.083651 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-8d770b44-715b-4cb2-b0ff-af187ccd33b3 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:18.084215 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-8d770b44-715b-4cb2-b0ff-af187ccd33b3 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:18.084990 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-8d770b44-715b-4cb2-b0ff-af187ccd33b3 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:18.085657 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-8d770b44-715b-4cb2-b0ff-af187ccd33b3 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:18.238685 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-8d770b44-715b-4cb2-b0ff-af187ccd33b3 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:18.247941 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-8d770b44-715b-4cb2-b0ff-af187ccd33b3 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1522 microversion: 2.1 time: 0.182032 May 26 18:02:18.248560 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 64/128] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:18 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:18.666183 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-236f98dd-7924-4ac5-ab9a-38825cb7a221 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:18.666953 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-236f98dd-7924-4ac5-ab9a-38825cb7a221 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:18.675060 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-236f98dd-7924-4ac5-ab9a-38825cb7a221 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:18.675515 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-236f98dd-7924-4ac5-ab9a-38825cb7a221 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:18.676325 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-236f98dd-7924-4ac5-ab9a-38825cb7a221 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:18.676799 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-236f98dd-7924-4ac5-ab9a-38825cb7a221 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:18.953368 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-236f98dd-7924-4ac5-ab9a-38825cb7a221 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:18.961166 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-236f98dd-7924-4ac5-ab9a-38825cb7a221 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1547 microversion: 2.1 time: 0.299258 May 26 18:02:18.961742 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 65/129] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:18 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1547 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:18.978686 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-baf99b3f-81d1-476e-a42d-bfb1a50e4478 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:18.979261 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-baf99b3f-81d1-476e-a42d-bfb1a50e4478 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:18.986327 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-baf99b3f-81d1-476e-a42d-bfb1a50e4478 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:18.987021 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-baf99b3f-81d1-476e-a42d-bfb1a50e4478 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:18.987995 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-baf99b3f-81d1-476e-a42d-bfb1a50e4478 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:18.988501 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-baf99b3f-81d1-476e-a42d-bfb1a50e4478 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:19.098218 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-baf99b3f-81d1-476e-a42d-bfb1a50e4478 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.123207 May 26 18:02:19.099261 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 65/130] 10.222.0.69 () {58 vars in 1274 bytes} [Thu May 26 18:02:18 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20/os-interface => generated 284 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:02:19.264100 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-e63bbf52-f2f5-4910-b184-048058c15948 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:19.264713 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-e63bbf52-f2f5-4910-b184-048058c15948 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:19.271659 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e63bbf52-f2f5-4910-b184-048058c15948 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:19.272143 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e63bbf52-f2f5-4910-b184-048058c15948 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:19.272926 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e63bbf52-f2f5-4910-b184-048058c15948 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:19.273365 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e63bbf52-f2f5-4910-b184-048058c15948 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:19.508661 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-e63bbf52-f2f5-4910-b184-048058c15948 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:19.521339 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-e63bbf52-f2f5-4910-b184-048058c15948 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1522 microversion: 2.1 time: 0.260635 May 26 18:02:19.522591 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 66/131] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:19 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:02:20.362488 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [req-84722886-3f38-4f3a-bd1c-e1946c3fd16d req-83b82a83-5e15-4d18-81bb-1e2b1354f606 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcca8b79-ed51-48fa-85ad-4af0a09f7c20", "tag": "b29d6acf-04aa-4714-90fd-8db0f59d3e5c"}]} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:02:20.371394 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-84722886-3f38-4f3a-bd1c-e1946c3fd16d req-83b82a83-5e15-4d18-81bb-1e2b1354f606 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:20.371980 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-84722886-3f38-4f3a-bd1c-e1946c3fd16d req-83b82a83-5e15-4d18-81bb-1e2b1354f606 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:20.387397 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.compute.server_external_events [req-84722886-3f38-4f3a-bd1c-e1946c3fd16d req-83b82a83-5e15-4d18-81bb-1e2b1354f606 service nova] Creating event network-changed:b29d6acf-04aa-4714-90fd-8db0f59d3e5c for instance bcca8b79-ed51-48fa-85ad-4af0a09f7c20 on hv-cinder-83607 May 26 18:02:20.392982 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [req-84722886-3f38-4f3a-bd1c-e1946c3fd16d req-83b82a83-5e15-4d18-81bb-1e2b1354f606 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035346 May 26 18:02:20.393605 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 66/132] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:02:20.539423 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-c4c7ddec-1a6f-4d26-80a0-78b326374ff1 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:20.540288 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-c4c7ddec-1a6f-4d26-80a0-78b326374ff1 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:20.547030 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c4c7ddec-1a6f-4d26-80a0-78b326374ff1 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:20.547572 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c4c7ddec-1a6f-4d26-80a0-78b326374ff1 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:20.550492 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c4c7ddec-1a6f-4d26-80a0-78b326374ff1 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:20.551081 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c4c7ddec-1a6f-4d26-80a0-78b326374ff1 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:20.722315 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-c4c7ddec-1a6f-4d26-80a0-78b326374ff1 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:20.731299 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-c4c7ddec-1a6f-4d26-80a0-78b326374ff1 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1522 microversion: 2.1 time: 0.195955 May 26 18:02:20.731996 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 67/133] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:20 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:21.749281 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-3861911c-84b5-472d-afe6-ad2b5a77a293 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:21.750549 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-3861911c-84b5-472d-afe6-ad2b5a77a293 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:21.760270 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3861911c-84b5-472d-afe6-ad2b5a77a293 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:21.760908 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3861911c-84b5-472d-afe6-ad2b5a77a293 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:21.761960 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3861911c-84b5-472d-afe6-ad2b5a77a293 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:21.762534 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3861911c-84b5-472d-afe6-ad2b5a77a293 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:21.931028 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-3861911c-84b5-472d-afe6-ad2b5a77a293 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:21.939814 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-3861911c-84b5-472d-afe6-ad2b5a77a293 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1522 microversion: 2.1 time: 0.194646 May 26 18:02:21.940689 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 67/134] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:21 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:22.958174 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-598aea3a-d0be-4f73-80b5-c7cbb888b3f1 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:22.958787 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-598aea3a-d0be-4f73-80b5-c7cbb888b3f1 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:22.964933 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-598aea3a-d0be-4f73-80b5-c7cbb888b3f1 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:22.965393 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-598aea3a-d0be-4f73-80b5-c7cbb888b3f1 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:22.966186 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-598aea3a-d0be-4f73-80b5-c7cbb888b3f1 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:22.966628 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-598aea3a-d0be-4f73-80b5-c7cbb888b3f1 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:23.099457 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-598aea3a-d0be-4f73-80b5-c7cbb888b3f1 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:23.107025 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-598aea3a-d0be-4f73-80b5-c7cbb888b3f1 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1522 microversion: 2.1 time: 0.153406 May 26 18:02:23.107604 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 68/135] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:22 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:24.132044 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-741805f7-d143-4144-835b-0655fe3e2046 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:24.132582 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-741805f7-d143-4144-835b-0655fe3e2046 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] [instance: 597e2bca-7106-4c57-9ce3-b73108629960] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:24.132869 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-35e92a15-87ae-4e37-a63e-cac01ba26984 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:24.133624 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-35e92a15-87ae-4e37-a63e-cac01ba26984 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:24.145112 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-741805f7-d143-4144-835b-0655fe3e2046 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:24.145424 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-35e92a15-87ae-4e37-a63e-cac01ba26984 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:24.145947 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-741805f7-d143-4144-835b-0655fe3e2046 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:24.146061 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-35e92a15-87ae-4e37-a63e-cac01ba26984 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:24.146847 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-35e92a15-87ae-4e37-a63e-cac01ba26984 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:24.147314 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-35e92a15-87ae-4e37-a63e-cac01ba26984 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:24.147603 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-741805f7-d143-4144-835b-0655fe3e2046 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:24.148375 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-741805f7-d143-4144-835b-0655fe3e2046 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:24.194427 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-741805f7-d143-4144-835b-0655fe3e2046 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] [instance: 597e2bca-7106-4c57-9ce3-b73108629960] Going to try to terminate instance {{(pid=117722) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:02:24.339436 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-741805f7-d143-4144-835b-0655fe3e2046 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] 10.222.0.69 "DELETE /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960" status: 204 len: 0 microversion: 2.1 time: 0.219750 May 26 18:02:24.340686 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 68/136] 10.222.0.69 () {58 vars in 1238 bytes} [Thu May 26 18:02:24 2022] DELETE /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 18:02:24.352032 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-d93e58e0-54e0-4b1b-a7f8-2eaa0fc8b2e0 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:24.356159 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-d93e58e0-54e0-4b1b-a7f8-2eaa0fc8b2e0 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] [instance: 597e2bca-7106-4c57-9ce3-b73108629960] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:24.364735 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d93e58e0-54e0-4b1b-a7f8-2eaa0fc8b2e0 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:24.365639 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d93e58e0-54e0-4b1b-a7f8-2eaa0fc8b2e0 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:24.366655 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d93e58e0-54e0-4b1b-a7f8-2eaa0fc8b2e0 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:24.367540 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d93e58e0-54e0-4b1b-a7f8-2eaa0fc8b2e0 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:24.444821 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-35e92a15-87ae-4e37-a63e-cac01ba26984 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:24.453569 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-35e92a15-87ae-4e37-a63e-cac01ba26984 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1522 microversion: 2.1 time: 0.332963 May 26 18:02:24.455550 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 69/137] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:24 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1522 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:24.553063 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-d93e58e0-54e0-4b1b-a7f8-2eaa0fc8b2e0 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caae6984c3b47c59f8b385af0b40f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41aaf61888b149a59ed741d201490e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:24.564349 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-d93e58e0-54e0-4b1b-a7f8-2eaa0fc8b2e0 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] 10.222.0.69 "GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960" status: 200 len: 1553 microversion: 2.1 time: 0.216671 May 26 18:02:24.564349 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 69/138] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:24 2022] GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960 => generated 1553 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:02:25.474274 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-b5da6cda-e3c8-45a1-af5c-222f04b59aca tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:25.475043 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-b5da6cda-e3c8-45a1-af5c-222f04b59aca tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:25.481378 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b5da6cda-e3c8-45a1-af5c-222f04b59aca tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:25.481838 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b5da6cda-e3c8-45a1-af5c-222f04b59aca tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:25.482625 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b5da6cda-e3c8-45a1-af5c-222f04b59aca tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:25.483323 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b5da6cda-e3c8-45a1-af5c-222f04b59aca tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:25.581109 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-a715e179-4207-4549-ad2c-eaaa2745037c tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:25.582513 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-a715e179-4207-4549-ad2c-eaaa2745037c tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] [instance: 597e2bca-7106-4c57-9ce3-b73108629960] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:25.591546 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-a715e179-4207-4549-ad2c-eaaa2745037c tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:25.592434 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-a715e179-4207-4549-ad2c-eaaa2745037c tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:25.593437 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-a715e179-4207-4549-ad2c-eaaa2745037c tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:25.594399 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-a715e179-4207-4549-ad2c-eaaa2745037c tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:25.635922 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-b5da6cda-e3c8-45a1-af5c-222f04b59aca tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:25.644788 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-b5da6cda-e3c8-45a1-af5c-222f04b59aca tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1522 microversion: 2.1 time: 0.175818 May 26 18:02:25.645377 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 70/139] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:25 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:02:25.833193 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-a715e179-4207-4549-ad2c-eaaa2745037c tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caae6984c3b47c59f8b385af0b40f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41aaf61888b149a59ed741d201490e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:25.839430 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-a715e179-4207-4549-ad2c-eaaa2745037c tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] 10.222.0.69 "GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960" status: 200 len: 1553 microversion: 2.1 time: 0.263411 May 26 18:02:25.840974 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 70/140] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:25 2022] GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960 => generated 1553 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:26.661978 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-e62602de-25e7-481a-9caa-d495db3c1baf tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:26.662720 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-e62602de-25e7-481a-9caa-d495db3c1baf tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:26.669005 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e62602de-25e7-481a-9caa-d495db3c1baf tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:26.669512 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e62602de-25e7-481a-9caa-d495db3c1baf tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:26.670256 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e62602de-25e7-481a-9caa-d495db3c1baf tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:26.670688 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e62602de-25e7-481a-9caa-d495db3c1baf tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:26.823138 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-e62602de-25e7-481a-9caa-d495db3c1baf tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:26.831776 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-e62602de-25e7-481a-9caa-d495db3c1baf tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1522 microversion: 2.1 time: 0.173771 May 26 18:02:26.832503 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 71/141] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:26 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:02:26.858421 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-3f4d1bf8-84ad-49ce-ab59-8b4d4a791650 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:26.859144 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-3f4d1bf8-84ad-49ce-ab59-8b4d4a791650 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] [instance: 597e2bca-7106-4c57-9ce3-b73108629960] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:26.866524 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3f4d1bf8-84ad-49ce-ab59-8b4d4a791650 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:26.866985 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3f4d1bf8-84ad-49ce-ab59-8b4d4a791650 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:26.867755 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3f4d1bf8-84ad-49ce-ab59-8b4d4a791650 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:26.868216 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3f4d1bf8-84ad-49ce-ab59-8b4d4a791650 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:27.010158 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-3f4d1bf8-84ad-49ce-ab59-8b4d4a791650 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caae6984c3b47c59f8b385af0b40f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41aaf61888b149a59ed741d201490e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:27.019060 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-3f4d1bf8-84ad-49ce-ab59-8b4d4a791650 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] 10.222.0.69 "GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960" status: 200 len: 1553 microversion: 2.1 time: 0.165137 May 26 18:02:27.019860 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 71/142] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:26 2022] GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960 => generated 1553 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:27.849202 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-d9213516-b606-431e-bd54-dc4d2e4e614d tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:27.849812 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-d9213516-b606-431e-bd54-dc4d2e4e614d tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:27.855902 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d9213516-b606-431e-bd54-dc4d2e4e614d tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:27.856395 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d9213516-b606-431e-bd54-dc4d2e4e614d tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:27.857173 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d9213516-b606-431e-bd54-dc4d2e4e614d tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:27.857870 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d9213516-b606-431e-bd54-dc4d2e4e614d tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:27.998274 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-d9213516-b606-431e-bd54-dc4d2e4e614d tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:28.006151 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-d9213516-b606-431e-bd54-dc4d2e4e614d tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1522 microversion: 2.1 time: 0.160797 May 26 18:02:28.006878 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 72/143] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:27 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:28.038006 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-129aede4-e850-42a7-8ef9-3ad4c4a3ce7c tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:28.038593 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-129aede4-e850-42a7-8ef9-3ad4c4a3ce7c tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] [instance: 597e2bca-7106-4c57-9ce3-b73108629960] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:28.045022 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-129aede4-e850-42a7-8ef9-3ad4c4a3ce7c tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:28.045466 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-129aede4-e850-42a7-8ef9-3ad4c4a3ce7c tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:28.046231 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-129aede4-e850-42a7-8ef9-3ad4c4a3ce7c tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:28.046662 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-129aede4-e850-42a7-8ef9-3ad4c4a3ce7c tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:28.051870 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:28.191264 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-129aede4-e850-42a7-8ef9-3ad4c4a3ce7c tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caae6984c3b47c59f8b385af0b40f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41aaf61888b149a59ed741d201490e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:28.199452 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-129aede4-e850-42a7-8ef9-3ad4c4a3ce7c tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] 10.222.0.69 "GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960" status: 200 len: 1553 microversion: 2.1 time: 0.165247 May 26 18:02:28.200134 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 72/144] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:28 2022] GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960 => generated 1553 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:29.023423 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-ffd1d044-df83-4fca-98c9-27c077c91d25 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:29.024149 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-ffd1d044-df83-4fca-98c9-27c077c91d25 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:29.030347 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ffd1d044-df83-4fca-98c9-27c077c91d25 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:29.030868 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ffd1d044-df83-4fca-98c9-27c077c91d25 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:29.031889 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ffd1d044-df83-4fca-98c9-27c077c91d25 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:29.033204 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ffd1d044-df83-4fca-98c9-27c077c91d25 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:29.109063 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [req-09b38712-dee2-4240-a2bc-c0536a6b6836 req-89356092-ef29-4c31-b581-f40df258a628 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "597e2bca-7106-4c57-9ce3-b73108629960", "name": "network-vif-deleted", "tag": "286236cd-e1bf-4690-8d1b-f843a4d0118f"}]} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:02:29.119088 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-09b38712-dee2-4240-a2bc-c0536a6b6836 req-89356092-ef29-4c31-b581-f40df258a628 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:29.119529 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-09b38712-dee2-4240-a2bc-c0536a6b6836 req-89356092-ef29-4c31-b581-f40df258a628 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:29.131819 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.compute.server_external_events [req-09b38712-dee2-4240-a2bc-c0536a6b6836 req-89356092-ef29-4c31-b581-f40df258a628 service nova] Creating event network-vif-deleted:286236cd-e1bf-4690-8d1b-f843a4d0118f for instance 597e2bca-7106-4c57-9ce3-b73108629960 on hv-cinder-83607 May 26 18:02:29.137153 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [req-09b38712-dee2-4240-a2bc-c0536a6b6836 req-89356092-ef29-4c31-b581-f40df258a628 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031923 May 26 18:02:29.138001 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 73/145] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:02:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:02:29.198386 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-ffd1d044-df83-4fca-98c9-27c077c91d25 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:29.206370 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-ffd1d044-df83-4fca-98c9-27c077c91d25 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1522 microversion: 2.1 time: 0.186781 May 26 18:02:29.206944 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 73/146] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:29 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:29.217935 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-cdd7f6cb-4a73-438c-819d-9ade24ad33f3 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:29.218637 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-cdd7f6cb-4a73-438c-819d-9ade24ad33f3 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] [instance: 597e2bca-7106-4c57-9ce3-b73108629960] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:29.225022 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-cdd7f6cb-4a73-438c-819d-9ade24ad33f3 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:29.225472 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-cdd7f6cb-4a73-438c-819d-9ade24ad33f3 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:29.226238 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-cdd7f6cb-4a73-438c-819d-9ade24ad33f3 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:29.226678 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-cdd7f6cb-4a73-438c-819d-9ade24ad33f3 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:29.293109 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-cdd7f6cb-4a73-438c-819d-9ade24ad33f3 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caae6984c3b47c59f8b385af0b40f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41aaf61888b149a59ed741d201490e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:29.301982 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-cdd7f6cb-4a73-438c-819d-9ade24ad33f3 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] 10.222.0.69 "GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960" status: 200 len: 1511 microversion: 2.1 time: 0.088278 May 26 18:02:29.302551 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 74/147] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:29 2022] GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960 => generated 1511 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:30.222518 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-bb1eeabf-1688-464c-84b9-30cd37556cec tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:30.223167 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-bb1eeabf-1688-464c-84b9-30cd37556cec tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:30.229369 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-bb1eeabf-1688-464c-84b9-30cd37556cec tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:30.229820 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-bb1eeabf-1688-464c-84b9-30cd37556cec tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:30.230591 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-bb1eeabf-1688-464c-84b9-30cd37556cec tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:30.231031 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-bb1eeabf-1688-464c-84b9-30cd37556cec tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:30.323352 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-00d48780-467e-43de-b060-c4ec72049f5d tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:30.323970 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-00d48780-467e-43de-b060-c4ec72049f5d tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] [instance: 597e2bca-7106-4c57-9ce3-b73108629960] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:30.332289 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-00d48780-467e-43de-b060-c4ec72049f5d tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:30.332735 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-00d48780-467e-43de-b060-c4ec72049f5d tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:30.333504 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-00d48780-467e-43de-b060-c4ec72049f5d tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:30.333937 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-00d48780-467e-43de-b060-c4ec72049f5d tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:30.369422 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-bb1eeabf-1688-464c-84b9-30cd37556cec tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:30.378556 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-bb1eeabf-1688-464c-84b9-30cd37556cec tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1522 microversion: 2.1 time: 0.159720 May 26 18:02:30.379418 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 74/148] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:30 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:30.410001 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-00d48780-467e-43de-b060-c4ec72049f5d tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caae6984c3b47c59f8b385af0b40f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41aaf61888b149a59ed741d201490e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:30.418274 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-00d48780-467e-43de-b060-c4ec72049f5d tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] 10.222.0.69 "GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960" status: 200 len: 1345 microversion: 2.1 time: 0.101380 May 26 18:02:30.419136 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 75/149] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:30 2022] GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960 => generated 1345 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:02:31.397557 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-572b0529-b3d0-452c-98a8-3ad945e7842b tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:31.398173 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-572b0529-b3d0-452c-98a8-3ad945e7842b tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:31.404952 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-572b0529-b3d0-452c-98a8-3ad945e7842b tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:31.405318 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-572b0529-b3d0-452c-98a8-3ad945e7842b tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:31.406100 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-572b0529-b3d0-452c-98a8-3ad945e7842b tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:31.407148 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-572b0529-b3d0-452c-98a8-3ad945e7842b tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:31.436658 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-618be563-189b-4056-abf6-3ee9264a7249 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:31.437490 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-618be563-189b-4056-abf6-3ee9264a7249 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] [instance: 597e2bca-7106-4c57-9ce3-b73108629960] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:31.444833 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-618be563-189b-4056-abf6-3ee9264a7249 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:31.445290 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-618be563-189b-4056-abf6-3ee9264a7249 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:31.446273 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-618be563-189b-4056-abf6-3ee9264a7249 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:31.446715 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-618be563-189b-4056-abf6-3ee9264a7249 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:31.514074 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-618be563-189b-4056-abf6-3ee9264a7249 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caae6984c3b47c59f8b385af0b40f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41aaf61888b149a59ed741d201490e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:31.523298 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-618be563-189b-4056-abf6-3ee9264a7249 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] 10.222.0.69 "GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960" status: 200 len: 1345 microversion: 2.1 time: 0.092225 May 26 18:02:31.523880 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 76/150] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:31 2022] GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960 => generated 1345 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:02:31.552363 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-572b0529-b3d0-452c-98a8-3ad945e7842b tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:31.560387 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-572b0529-b3d0-452c-98a8-3ad945e7842b tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1522 microversion: 2.1 time: 0.166780 May 26 18:02:31.560975 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 75/151] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:31 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:32.541006 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-f4fecdeb-57db-4203-ad49-e932d17894d7 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:32.541610 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-f4fecdeb-57db-4203-ad49-e932d17894d7 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] [instance: 597e2bca-7106-4c57-9ce3-b73108629960] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:32.548703 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-f4fecdeb-57db-4203-ad49-e932d17894d7 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:32.549145 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-f4fecdeb-57db-4203-ad49-e932d17894d7 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:32.549901 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-f4fecdeb-57db-4203-ad49-e932d17894d7 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:32.550328 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-f4fecdeb-57db-4203-ad49-e932d17894d7 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:32.578211 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-e8117117-bd32-4f7b-a402-e3841bc4c037 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:32.579365 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-e8117117-bd32-4f7b-a402-e3841bc4c037 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:32.589045 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e8117117-bd32-4f7b-a402-e3841bc4c037 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:32.589489 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e8117117-bd32-4f7b-a402-e3841bc4c037 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:32.590259 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e8117117-bd32-4f7b-a402-e3841bc4c037 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:32.590698 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e8117117-bd32-4f7b-a402-e3841bc4c037 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:32.616252 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-f4fecdeb-57db-4203-ad49-e932d17894d7 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9caae6984c3b47c59f8b385af0b40f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41aaf61888b149a59ed741d201490e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:32.625220 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-f4fecdeb-57db-4203-ad49-e932d17894d7 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] 10.222.0.69 "GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960" status: 200 len: 1345 microversion: 2.1 time: 0.087960 May 26 18:02:32.625822 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 77/152] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:32 2022] GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960 => generated 1345 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:32.730391 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-e8117117-bd32-4f7b-a402-e3841bc4c037 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:32.738789 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-e8117117-bd32-4f7b-a402-e3841bc4c037 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1522 microversion: 2.1 time: 0.164734 May 26 18:02:32.739356 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 76/153] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:32 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:02:33.644157 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-184fb516-f0d8-4e8b-9baa-bc22b209ee87 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:33.644874 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-184fb516-f0d8-4e8b-9baa-bc22b209ee87 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] [instance: 597e2bca-7106-4c57-9ce3-b73108629960] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:33.652544 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-184fb516-f0d8-4e8b-9baa-bc22b209ee87 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:33.653000 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-184fb516-f0d8-4e8b-9baa-bc22b209ee87 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:33.653780 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-184fb516-f0d8-4e8b-9baa-bc22b209ee87 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:33.654252 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-184fb516-f0d8-4e8b-9baa-bc22b209ee87 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:33.671507 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.wsgi [None req-184fb516-f0d8-4e8b-9baa-bc22b209ee87 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] HTTP exception thrown: Instance 597e2bca-7106-4c57-9ce3-b73108629960 could not be found. May 26 18:02:33.685802 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-184fb516-f0d8-4e8b-9baa-bc22b209ee87 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Request method failure captured: May 26 18:02:33.685802 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: request: GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960 HTTP/1.1 May 26 18:02:33.685802 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Accept: application/json May 26 18:02:33.685802 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Accept-Encoding: identity May 26 18:02:33.685802 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Connection: close May 26 18:02:33.685802 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Content-Length: 0 May 26 18:02:33.685802 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Content-Type: application/json May 26 18:02:33.685802 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Host: 10.222.0.69 May 26 18:02:33.685802 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Openstack-System-Scope: None May 26 18:02:33.685802 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: User-Agent: python-urllib3/1.26.9 May 26 18:02:33.685802 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Auth-Token: gAAAAABij8BpaJN32EOCA2OgsclMlsw1GoYNqUr3y4Gb-xqCsOSriekUxUEn8SesV-OgdQYWEdyVJQ4vtuRXiNVJhjTysE8pbtqFhKRIS7-ARnqKyEsmIrsSoEm3IzByRsB_jr9a0-ROI4vZhnoUEuvkFkRJrbeFaoIgYfd6mH13nuN5lSAF598 May 26 18:02:33.685802 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Domain-Id: None May 26 18:02:33.685802 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Domain-Name: None May 26 18:02:33.685802 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Identity-Status: Confirmed May 26 18:02:33.685802 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Is-Admin-Project: True May 26 18:02:33.685802 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Domain-Id: default May 26 18:02:33.685802 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Domain-Name: Default May 26 18:02:33.685802 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Id: 41aaf61888b149a59ed741d201490e52 May 26 18:02:33.685802 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Name: tempest-DeleteServersTestJSON-307311846 May 26 18:02:33.685802 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Role: member,reader May 26 18:02:33.685802 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Roles: member,reader May 26 18:02:33.687260 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/41aaf61888b149a59ed741d201490e52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/41aaf61888b149a59ed741d201490e52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/41aaf61888b149a59ed741d201490e52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_41aaf61888b149a59ed741d201490e52"}]}] May 26 18:02:33.687260 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant: tempest-DeleteServersTestJSON-307311846 May 26 18:02:33.687260 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant-Id: 41aaf61888b149a59ed741d201490e52 May 26 18:02:33.687260 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant-Name: tempest-DeleteServersTestJSON-307311846 May 26 18:02:33.687260 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User: tempest-DeleteServersTestJSON-307311846-project May 26 18:02:33.687260 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Domain-Id: default May 26 18:02:33.687260 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Domain-Name: Default May 26 18:02:33.687260 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Id: 9caae6984c3b47c59f8b385af0b40f98 May 26 18:02:33.687260 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Name: tempest-DeleteServersTestJSON-307311846-project May 26 18:02:33.687260 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: method: > May 26 18:02:33.687260 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: exception: Instance 597e2bca-7106-4c57-9ce3-b73108629960 could not be found. May 26 18:02:33.687260 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: action_args: {'id': '597e2bca-7106-4c57-9ce3-b73108629960'} May 26 18:02:33.688422 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:02:33.688422 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:02:33.688422 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:02:33.688422 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:02:33.688422 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:02:33.688422 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:02:33.688422 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:02:33.688422 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:02:33.688422 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:02:33.688422 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:02:33.688422 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 597e2bca-7106-4c57-9ce3-b73108629960 could not be found. May 26 18:02:33.688422 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:02:33.688422 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:02:33.688422 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:02:33.688422 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:02:33.688422 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:02:33.688422 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:02:33.688422 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:02:33.688422 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:02:33.688422 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:02:33.689785 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:02:33.689785 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:02:33.689785 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:02:33.689785 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:02:33.689785 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:02:33.689785 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:02:33.689785 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:02:33.689785 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 597e2bca-7106-4c57-9ce3-b73108629960 could not be found. May 26 18:02:33.689785 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:02:33.689785 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:02:33.689785 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:02:33.689785 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:02:33.689785 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:02:33.689785 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:02:33.689785 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:02:33.689785 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:02:33.689785 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 597e2bca-7106-4c57-9ce3-b73108629960 could not be found. May 26 18:02:33.689785 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:02:33.691126 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-184fb516-f0d8-4e8b-9baa-bc22b209ee87 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Returning 404 to user: Instance 597e2bca-7106-4c57-9ce3-b73108629960 could not be found. {{(pid=117722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:02:33.691126 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-184fb516-f0d8-4e8b-9baa-bc22b209ee87 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] 10.222.0.69 "GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960" status: 404 len: 111 microversion: 2.1 time: 0.048585 May 26 18:02:33.691126 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 78/154] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:33 2022] GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:02:33.757688 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-8b2379e0-5470-47fd-a701-1c93401eb4e8 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:33.758814 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-8b2379e0-5470-47fd-a701-1c93401eb4e8 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:33.769059 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8b2379e0-5470-47fd-a701-1c93401eb4e8 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:33.769434 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8b2379e0-5470-47fd-a701-1c93401eb4e8 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:33.770222 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8b2379e0-5470-47fd-a701-1c93401eb4e8 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:33.770664 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8b2379e0-5470-47fd-a701-1c93401eb4e8 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:33.800064 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-6f0c4b60-a7cd-44d3-886e-5691407d5ad7 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:33.801042 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-6f0c4b60-a7cd-44d3-886e-5691407d5ad7 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] [instance: 597e2bca-7106-4c57-9ce3-b73108629960] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:33.807339 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-6f0c4b60-a7cd-44d3-886e-5691407d5ad7 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:33.807790 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-6f0c4b60-a7cd-44d3-886e-5691407d5ad7 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:33.808607 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-6f0c4b60-a7cd-44d3-886e-5691407d5ad7 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:33.809100 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-6f0c4b60-a7cd-44d3-886e-5691407d5ad7 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:33.827652 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.wsgi [None req-6f0c4b60-a7cd-44d3-886e-5691407d5ad7 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] HTTP exception thrown: Instance 597e2bca-7106-4c57-9ce3-b73108629960 could not be found. May 26 18:02:33.842372 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-6f0c4b60-a7cd-44d3-886e-5691407d5ad7 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Request method failure captured: May 26 18:02:33.842372 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: request: GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960/os-volume_attachments HTTP/1.1 May 26 18:02:33.842372 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Accept: application/json May 26 18:02:33.842372 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Accept-Encoding: identity May 26 18:02:33.842372 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Connection: close May 26 18:02:33.842372 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Content-Length: 0 May 26 18:02:33.842372 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Content-Type: application/json May 26 18:02:33.842372 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Host: 10.222.0.69 May 26 18:02:33.842372 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Openstack-System-Scope: None May 26 18:02:33.842372 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: User-Agent: python-urllib3/1.26.9 May 26 18:02:33.842372 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Auth-Token: gAAAAABij8BpaJN32EOCA2OgsclMlsw1GoYNqUr3y4Gb-xqCsOSriekUxUEn8SesV-OgdQYWEdyVJQ4vtuRXiNVJhjTysE8pbtqFhKRIS7-ARnqKyEsmIrsSoEm3IzByRsB_jr9a0-ROI4vZhnoUEuvkFkRJrbeFaoIgYfd6mH13nuN5lSAF598 May 26 18:02:33.842372 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Domain-Id: None May 26 18:02:33.842372 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Domain-Name: None May 26 18:02:33.842372 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Identity-Status: Confirmed May 26 18:02:33.842372 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Is-Admin-Project: True May 26 18:02:33.842372 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Domain-Id: default May 26 18:02:33.842372 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Domain-Name: Default May 26 18:02:33.842372 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Id: 41aaf61888b149a59ed741d201490e52 May 26 18:02:33.842372 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Name: tempest-DeleteServersTestJSON-307311846 May 26 18:02:33.842372 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Role: member,reader May 26 18:02:33.842372 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Roles: member,reader May 26 18:02:33.843747 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/41aaf61888b149a59ed741d201490e52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/41aaf61888b149a59ed741d201490e52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/41aaf61888b149a59ed741d201490e52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_41aaf61888b149a59ed741d201490e52"}]}] May 26 18:02:33.843747 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant: tempest-DeleteServersTestJSON-307311846 May 26 18:02:33.843747 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant-Id: 41aaf61888b149a59ed741d201490e52 May 26 18:02:33.843747 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant-Name: tempest-DeleteServersTestJSON-307311846 May 26 18:02:33.843747 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User: tempest-DeleteServersTestJSON-307311846-project May 26 18:02:33.843747 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Domain-Id: default May 26 18:02:33.843747 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Domain-Name: Default May 26 18:02:33.843747 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Id: 9caae6984c3b47c59f8b385af0b40f98 May 26 18:02:33.843747 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Name: tempest-DeleteServersTestJSON-307311846-project May 26 18:02:33.843747 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: method: > May 26 18:02:33.843747 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: exception: Instance 597e2bca-7106-4c57-9ce3-b73108629960 could not be found. May 26 18:02:33.843747 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: action_args: {'server_id': '597e2bca-7106-4c57-9ce3-b73108629960'} May 26 18:02:33.844679 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:02:33.844679 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:02:33.844679 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:02:33.844679 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:02:33.844679 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:02:33.844679 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:02:33.844679 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:02:33.844679 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:02:33.844679 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:02:33.844679 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:02:33.844679 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 597e2bca-7106-4c57-9ce3-b73108629960 could not be found. May 26 18:02:33.844679 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:02:33.844679 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:02:33.844679 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:02:33.844679 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:02:33.844679 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:02:33.844679 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:02:33.844679 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:02:33.844679 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:02:33.844679 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:02:33.845816 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:02:33.845816 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 26 18:02:33.845816 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 18:02:33.845816 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 26 18:02:33.845816 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 18:02:33.845816 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 26 18:02:33.845816 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 26 18:02:33.845816 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:02:33.845816 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:02:33.845816 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 597e2bca-7106-4c57-9ce3-b73108629960 could not be found. May 26 18:02:33.845816 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:02:33.845816 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:02:33.845816 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:02:33.845816 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:02:33.845816 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:02:33.845816 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:02:33.845816 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:02:33.845816 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:02:33.845816 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 597e2bca-7106-4c57-9ce3-b73108629960 could not be found. May 26 18:02:33.845816 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:02:33.848213 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-6f0c4b60-a7cd-44d3-886e-5691407d5ad7 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Returning 404 to user: Instance 597e2bca-7106-4c57-9ce3-b73108629960 could not be found. {{(pid=117722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:02:33.848213 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-6f0c4b60-a7cd-44d3-886e-5691407d5ad7 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] 10.222.0.69 "GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.049305 May 26 18:02:33.848213 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 79/155] 10.222.0.69 () {58 vars in 1301 bytes} [Thu May 26 18:02:33 2022] GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960/os-volume_attachments => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 18:02:33.919536 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-8b2379e0-5470-47fd-a701-1c93401eb4e8 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:33.927571 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-8b2379e0-5470-47fd-a701-1c93401eb4e8 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1522 microversion: 2.1 time: 0.174551 May 26 18:02:33.928189 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 77/156] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:33 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:34.944981 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-9cdcbc65-4a92-4e35-a44c-5ebf6caabbd1 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:34.946381 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-9cdcbc65-4a92-4e35-a44c-5ebf6caabbd1 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:34.960246 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-9cdcbc65-4a92-4e35-a44c-5ebf6caabbd1 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:34.961061 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-9cdcbc65-4a92-4e35-a44c-5ebf6caabbd1 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:34.961893 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-9cdcbc65-4a92-4e35-a44c-5ebf6caabbd1 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:34.962278 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-9cdcbc65-4a92-4e35-a44c-5ebf6caabbd1 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:35.061536 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-d72902dc-2588-46dd-82b0-7ff337090c56 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:35.062028 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-d72902dc-2588-46dd-82b0-7ff337090c56 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] [instance: 597e2bca-7106-4c57-9ce3-b73108629960] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:35.070240 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d72902dc-2588-46dd-82b0-7ff337090c56 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:35.070789 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d72902dc-2588-46dd-82b0-7ff337090c56 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:35.071642 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d72902dc-2588-46dd-82b0-7ff337090c56 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:35.072204 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d72902dc-2588-46dd-82b0-7ff337090c56 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:35.093262 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.wsgi [None req-d72902dc-2588-46dd-82b0-7ff337090c56 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] HTTP exception thrown: Instance 597e2bca-7106-4c57-9ce3-b73108629960 could not be found. May 26 18:02:35.100220 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-d72902dc-2588-46dd-82b0-7ff337090c56 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Request method failure captured: May 26 18:02:35.100220 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: request: DELETE /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960 HTTP/1.1 May 26 18:02:35.100220 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Accept: application/json May 26 18:02:35.100220 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Accept-Encoding: identity May 26 18:02:35.100220 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Connection: close May 26 18:02:35.100220 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Content-Length: 0 May 26 18:02:35.100220 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Content-Type: application/json May 26 18:02:35.100220 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Host: 10.222.0.69 May 26 18:02:35.100220 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Openstack-System-Scope: None May 26 18:02:35.100220 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: User-Agent: python-urllib3/1.26.9 May 26 18:02:35.100220 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Auth-Token: gAAAAABij8BpaJN32EOCA2OgsclMlsw1GoYNqUr3y4Gb-xqCsOSriekUxUEn8SesV-OgdQYWEdyVJQ4vtuRXiNVJhjTysE8pbtqFhKRIS7-ARnqKyEsmIrsSoEm3IzByRsB_jr9a0-ROI4vZhnoUEuvkFkRJrbeFaoIgYfd6mH13nuN5lSAF598 May 26 18:02:35.100220 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Domain-Id: None May 26 18:02:35.100220 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Domain-Name: None May 26 18:02:35.100220 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Identity-Status: Confirmed May 26 18:02:35.100220 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Is-Admin-Project: True May 26 18:02:35.100220 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Domain-Id: default May 26 18:02:35.100220 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Domain-Name: Default May 26 18:02:35.100220 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Id: 41aaf61888b149a59ed741d201490e52 May 26 18:02:35.100220 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Name: tempest-DeleteServersTestJSON-307311846 May 26 18:02:35.100220 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Role: member,reader May 26 18:02:35.100220 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Roles: member,reader May 26 18:02:35.101816 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/41aaf61888b149a59ed741d201490e52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/41aaf61888b149a59ed741d201490e52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/41aaf61888b149a59ed741d201490e52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_41aaf61888b149a59ed741d201490e52"}]}] May 26 18:02:35.101816 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant: tempest-DeleteServersTestJSON-307311846 May 26 18:02:35.101816 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant-Id: 41aaf61888b149a59ed741d201490e52 May 26 18:02:35.101816 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant-Name: tempest-DeleteServersTestJSON-307311846 May 26 18:02:35.101816 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User: tempest-DeleteServersTestJSON-307311846-project May 26 18:02:35.101816 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Domain-Id: default May 26 18:02:35.101816 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Domain-Name: Default May 26 18:02:35.101816 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Id: 9caae6984c3b47c59f8b385af0b40f98 May 26 18:02:35.101816 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Name: tempest-DeleteServersTestJSON-307311846-project May 26 18:02:35.101816 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: method: > May 26 18:02:35.101816 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: exception: Instance 597e2bca-7106-4c57-9ce3-b73108629960 could not be found. May 26 18:02:35.101816 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: action_args: {'id': '597e2bca-7106-4c57-9ce3-b73108629960'} May 26 18:02:35.102600 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:02:35.102600 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:02:35.102600 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:02:35.102600 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:02:35.102600 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:02:35.102600 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:02:35.102600 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:02:35.102600 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:02:35.102600 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:02:35.102600 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:02:35.102600 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 597e2bca-7106-4c57-9ce3-b73108629960 could not be found. May 26 18:02:35.102600 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:02:35.102600 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:02:35.102600 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:02:35.102600 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:02:35.102600 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:02:35.102600 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:02:35.102600 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:02:35.102600 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:02:35.102600 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:02:35.103893 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:02:35.103893 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 18:02:35.103893 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 18:02:35.103893 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 18:02:35.103893 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 18:02:35.103893 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:02:35.103893 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:02:35.103893 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:02:35.103893 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:02:35.103893 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 597e2bca-7106-4c57-9ce3-b73108629960 could not be found. May 26 18:02:35.103893 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:02:35.103893 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:02:35.103893 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:02:35.103893 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:02:35.103893 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:02:35.103893 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:02:35.103893 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:02:35.103893 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:02:35.103893 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 597e2bca-7106-4c57-9ce3-b73108629960 could not be found. May 26 18:02:35.103893 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:02:35.105583 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-d72902dc-2588-46dd-82b0-7ff337090c56 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Returning 404 to user: Instance 597e2bca-7106-4c57-9ce3-b73108629960 could not be found. {{(pid=117723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:02:35.105583 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-d72902dc-2588-46dd-82b0-7ff337090c56 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] 10.222.0.69 "DELETE /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960" status: 404 len: 111 microversion: 2.1 time: 0.048754 May 26 18:02:35.105583 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 78/157] 10.222.0.69 () {58 vars in 1238 bytes} [Thu May 26 18:02:35 2022] DELETE /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:02:35.117775 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-4111426c-41c9-4a4b-8617-ff70f22c6c55 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:35.117775 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-4111426c-41c9-4a4b-8617-ff70f22c6c55 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] [instance: 597e2bca-7106-4c57-9ce3-b73108629960] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:35.118957 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-9cdcbc65-4a92-4e35-a44c-5ebf6caabbd1 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:35.127266 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-9cdcbc65-4a92-4e35-a44c-5ebf6caabbd1 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1522 microversion: 2.1 time: 0.186238 May 26 18:02:35.127847 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 80/158] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:34 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:35.134632 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4111426c-41c9-4a4b-8617-ff70f22c6c55 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:35.135092 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4111426c-41c9-4a4b-8617-ff70f22c6c55 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:35.135992 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4111426c-41c9-4a4b-8617-ff70f22c6c55 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:35.136617 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4111426c-41c9-4a4b-8617-ff70f22c6c55 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:35.161416 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.wsgi [None req-4111426c-41c9-4a4b-8617-ff70f22c6c55 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] HTTP exception thrown: Instance 597e2bca-7106-4c57-9ce3-b73108629960 could not be found. May 26 18:02:35.163407 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-4111426c-41c9-4a4b-8617-ff70f22c6c55 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Request method failure captured: May 26 18:02:35.163407 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: request: GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960 HTTP/1.1 May 26 18:02:35.163407 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Accept: application/json May 26 18:02:35.163407 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Accept-Encoding: identity May 26 18:02:35.163407 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Connection: close May 26 18:02:35.163407 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Content-Length: 0 May 26 18:02:35.163407 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Content-Type: application/json May 26 18:02:35.163407 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Host: 10.222.0.69 May 26 18:02:35.163407 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Openstack-System-Scope: None May 26 18:02:35.163407 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: User-Agent: python-urllib3/1.26.9 May 26 18:02:35.163407 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Auth-Token: gAAAAABij8BpaJN32EOCA2OgsclMlsw1GoYNqUr3y4Gb-xqCsOSriekUxUEn8SesV-OgdQYWEdyVJQ4vtuRXiNVJhjTysE8pbtqFhKRIS7-ARnqKyEsmIrsSoEm3IzByRsB_jr9a0-ROI4vZhnoUEuvkFkRJrbeFaoIgYfd6mH13nuN5lSAF598 May 26 18:02:35.163407 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Domain-Id: None May 26 18:02:35.163407 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Domain-Name: None May 26 18:02:35.163407 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Identity-Status: Confirmed May 26 18:02:35.163407 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Is-Admin-Project: True May 26 18:02:35.163407 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Domain-Id: default May 26 18:02:35.163407 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Domain-Name: Default May 26 18:02:35.163407 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Id: 41aaf61888b149a59ed741d201490e52 May 26 18:02:35.163407 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Name: tempest-DeleteServersTestJSON-307311846 May 26 18:02:35.163407 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Role: member,reader May 26 18:02:35.163407 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Roles: member,reader May 26 18:02:35.164529 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/41aaf61888b149a59ed741d201490e52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/41aaf61888b149a59ed741d201490e52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/41aaf61888b149a59ed741d201490e52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_41aaf61888b149a59ed741d201490e52"}]}] May 26 18:02:35.164529 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant: tempest-DeleteServersTestJSON-307311846 May 26 18:02:35.164529 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant-Id: 41aaf61888b149a59ed741d201490e52 May 26 18:02:35.164529 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant-Name: tempest-DeleteServersTestJSON-307311846 May 26 18:02:35.164529 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User: tempest-DeleteServersTestJSON-307311846-project May 26 18:02:35.164529 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Domain-Id: default May 26 18:02:35.164529 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Domain-Name: Default May 26 18:02:35.164529 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Id: 9caae6984c3b47c59f8b385af0b40f98 May 26 18:02:35.164529 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Name: tempest-DeleteServersTestJSON-307311846-project May 26 18:02:35.164529 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: method: > May 26 18:02:35.164529 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: exception: Instance 597e2bca-7106-4c57-9ce3-b73108629960 could not be found. May 26 18:02:35.164529 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: action_args: {'id': '597e2bca-7106-4c57-9ce3-b73108629960'} May 26 18:02:35.165483 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:02:35.165483 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:02:35.165483 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:02:35.165483 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:02:35.165483 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:02:35.165483 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:02:35.165483 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:02:35.165483 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:02:35.165483 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:02:35.165483 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:02:35.165483 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 597e2bca-7106-4c57-9ce3-b73108629960 could not be found. May 26 18:02:35.165483 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:02:35.165483 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:02:35.165483 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:02:35.165483 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:02:35.165483 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:02:35.165483 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:02:35.165483 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:02:35.165483 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:02:35.165483 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:02:35.166636 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:02:35.166636 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:02:35.166636 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:02:35.166636 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:02:35.166636 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:02:35.166636 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:02:35.166636 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:02:35.166636 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 597e2bca-7106-4c57-9ce3-b73108629960 could not be found. May 26 18:02:35.166636 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:02:35.166636 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:02:35.166636 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:02:35.166636 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:02:35.166636 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:02:35.166636 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:02:35.166636 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:02:35.166636 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:02:35.166636 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 597e2bca-7106-4c57-9ce3-b73108629960 could not be found. May 26 18:02:35.166636 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:02:35.167559 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-4111426c-41c9-4a4b-8617-ff70f22c6c55 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] Returning 404 to user: Instance 597e2bca-7106-4c57-9ce3-b73108629960 could not be found. {{(pid=117723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:02:35.167559 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-4111426c-41c9-4a4b-8617-ff70f22c6c55 tempest-DeleteServersTestJSON-307311846 tempest-DeleteServersTestJSON-307311846-project] 10.222.0.69 "GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960" status: 404 len: 111 microversion: 2.1 time: 0.055698 May 26 18:02:35.167559 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 79/159] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:35 2022] GET /compute/v2.1/servers/597e2bca-7106-4c57-9ce3-b73108629960 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 18:02:36.145259 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-f0d3ad5c-de42-4dd1-ab28-1a1324265b3f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:36.150163 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-f0d3ad5c-de42-4dd1-ab28-1a1324265b3f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:36.156809 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-f0d3ad5c-de42-4dd1-ab28-1a1324265b3f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:36.157698 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-f0d3ad5c-de42-4dd1-ab28-1a1324265b3f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:36.158667 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-f0d3ad5c-de42-4dd1-ab28-1a1324265b3f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:36.159330 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-f0d3ad5c-de42-4dd1-ab28-1a1324265b3f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:36.357878 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-f0d3ad5c-de42-4dd1-ab28-1a1324265b3f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:36.375353 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-f0d3ad5c-de42-4dd1-ab28-1a1324265b3f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1522 microversion: 2.1 time: 0.233946 May 26 18:02:36.393338 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 81/160] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:36 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:37.399477 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-e99ff3a5-2c44-412c-987d-32aade074dec tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:37.400237 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-e99ff3a5-2c44-412c-987d-32aade074dec tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:37.409105 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e99ff3a5-2c44-412c-987d-32aade074dec tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:37.409564 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e99ff3a5-2c44-412c-987d-32aade074dec tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:37.410788 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e99ff3a5-2c44-412c-987d-32aade074dec tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:37.411235 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e99ff3a5-2c44-412c-987d-32aade074dec tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:37.573501 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-e99ff3a5-2c44-412c-987d-32aade074dec tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:37.589389 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-e99ff3a5-2c44-412c-987d-32aade074dec tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1522 microversion: 2.1 time: 0.193658 May 26 18:02:37.590322 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 80/161] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:37 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:38.609834 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-b8b01fed-297e-4ee6-b8c6-84c8a94d892d tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:38.611412 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-b8b01fed-297e-4ee6-b8c6-84c8a94d892d tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:38.619757 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b8b01fed-297e-4ee6-b8c6-84c8a94d892d tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:38.620342 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b8b01fed-297e-4ee6-b8c6-84c8a94d892d tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:38.621677 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b8b01fed-297e-4ee6-b8c6-84c8a94d892d tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:38.622377 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b8b01fed-297e-4ee6-b8c6-84c8a94d892d tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:38.850451 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-b8b01fed-297e-4ee6-b8c6-84c8a94d892d tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:38.859723 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-b8b01fed-297e-4ee6-b8c6-84c8a94d892d tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1522 microversion: 2.1 time: 0.254231 May 26 18:02:38.860571 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 82/162] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:38 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:39.877883 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-a494cd09-8502-4238-9a2c-1a8e5affad78 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:39.878658 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-a494cd09-8502-4238-9a2c-1a8e5affad78 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:39.891939 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a494cd09-8502-4238-9a2c-1a8e5affad78 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:39.895570 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a494cd09-8502-4238-9a2c-1a8e5affad78 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:39.896440 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a494cd09-8502-4238-9a2c-1a8e5affad78 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:39.896889 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a494cd09-8502-4238-9a2c-1a8e5affad78 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:40.117267 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-a494cd09-8502-4238-9a2c-1a8e5affad78 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:40.125367 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-a494cd09-8502-4238-9a2c-1a8e5affad78 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1522 microversion: 2.1 time: 0.251165 May 26 18:02:40.125958 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 81/163] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:39 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:41.098049 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-a2f9520f-00b1-4675-a5a5-f13e82519e77 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1018496003", "imageRef": "16351c96-cb02-4711-99d5-fd4d80e8a846", "flavorRef": "452", "networks": [{"uuid": "3c59b880-8c40-4026-aca1-e87d209962e4"}]}} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:02:41.116765 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:41.148041 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-0f9fbe16-f1e0-44fe-9086-d2b5ff6a3e7c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:41.150858 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-0f9fbe16-f1e0-44fe-9086-d2b5ff6a3e7c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:41.159044 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0f9fbe16-f1e0-44fe-9086-d2b5ff6a3e7c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:41.159506 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0f9fbe16-f1e0-44fe-9086-d2b5ff6a3e7c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:41.160347 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0f9fbe16-f1e0-44fe-9086-d2b5ff6a3e7c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:41.160788 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0f9fbe16-f1e0-44fe-9086-d2b5ff6a3e7c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:41.177306 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.network.neutron [None req-a2f9520f-00b1-4675-a5a5-f13e82519e77 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] validate_networks() for [('3c59b880-8c40-4026-aca1-e87d209962e4', None, None, None, None, None)] {{(pid=117722) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:02:41.542644 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-0f9fbe16-f1e0-44fe-9086-d2b5ff6a3e7c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:41.551431 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=100 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:41.558896 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-0f9fbe16-f1e0-44fe-9086-d2b5ff6a3e7c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1522 microversion: 2.1 time: 0.414559 May 26 18:02:41.577063 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 82/164] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:41 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1522 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:41.720848 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.virt.hardware [None req-a2f9520f-00b1-4675-a5a5-f13e82519e77 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Flavor limits 0:0:0 {{(pid=117722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:02:41.721278 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.virt.hardware [None req-a2f9520f-00b1-4675-a5a5-f13e82519e77 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Image limits 0:0:0 {{(pid=117722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:02:41.721757 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.virt.hardware [None req-a2f9520f-00b1-4675-a5a5-f13e82519e77 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Flavor pref 0:0:0 {{(pid=117722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:02:41.722170 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.virt.hardware [None req-a2f9520f-00b1-4675-a5a5-f13e82519e77 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Image pref 0:0:0 {{(pid=117722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:02:41.722588 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.virt.hardware [None req-a2f9520f-00b1-4675-a5a5-f13e82519e77 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:02:41.744396 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-a2f9520f-00b1-4675-a5a5-f13e82519e77 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:41.744854 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-a2f9520f-00b1-4675-a5a5-f13e82519e77 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:41.748370 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-a2f9520f-00b1-4675-a5a5-f13e82519e77 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:41.749048 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-a2f9520f-00b1-4675-a5a5-f13e82519e77 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:41.786012 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.quota [None req-a2f9520f-00b1-4675-a5a5-f13e82519e77 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Getting quotas for project 9fdf6152e6874f78825e5eddb7f14158. Resources: {'instances', 'ram', 'cores'} {{(pid=117722) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:02:41.790730 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.quota [None req-a2f9520f-00b1-4675-a5a5-f13e82519e77 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Getting quotas for user f8b8f37c287341848d8d3b4d5f62873d and project 9fdf6152e6874f78825e5eddb7f14158. Resources: {'instances', 'ram', 'cores'} {{(pid=117722) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:02:41.803898 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-a2f9520f-00b1-4675-a5a5-f13e82519e77 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Going to run 1 instances... {{(pid=117722) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:02:41.806553 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-a2f9520f-00b1-4675-a5a5-f13e82519e77 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] [instance: cd2fb019-75ed-45ea-948b-64a627396f02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='16351c96-cb02-4711-99d5-fd4d80e8a846',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:02:41.861278 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-a2f9520f-00b1-4675-a5a5-f13e82519e77 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.778980 May 26 18:02:41.861942 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 83/165] 10.222.0.69 () {60 vars in 1146 bytes} [Thu May 26 18:02:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 780 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 18:02:41.875220 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-4109cebc-4b6c-4aab-9bcb-ce8fd7089fca tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:41.884702 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-4109cebc-4b6c-4aab-9bcb-ce8fd7089fca tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] [instance: cd2fb019-75ed-45ea-948b-64a627396f02] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:42.010786 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-4109cebc-4b6c-4aab-9bcb-ce8fd7089fca tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b8f37c287341848d8d3b4d5f62873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fdf6152e6874f78825e5eddb7f14158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:42.020875 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-4109cebc-4b6c-4aab-9bcb-ce8fd7089fca tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] 10.222.0.69 "GET /compute/v2.1/servers/cd2fb019-75ed-45ea-948b-64a627396f02" status: 200 len: 1219 microversion: 2.1 time: 0.152631 May 26 18:02:42.022508 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 83/166] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:41 2022] GET /compute/v2.1/servers/cd2fb019-75ed-45ea-948b-64a627396f02 => generated 1219 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:42.582942 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-cf1da5b9-f454-4dc9-b965-2c88c83a03b9 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:42.584117 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-cf1da5b9-f454-4dc9-b965-2c88c83a03b9 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:42.591837 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-cf1da5b9-f454-4dc9-b965-2c88c83a03b9 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:42.592326 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-cf1da5b9-f454-4dc9-b965-2c88c83a03b9 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:42.593171 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-cf1da5b9-f454-4dc9-b965-2c88c83a03b9 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:42.594480 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-cf1da5b9-f454-4dc9-b965-2c88c83a03b9 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:42.778773 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-cf1da5b9-f454-4dc9-b965-2c88c83a03b9 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:42.798589 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-cf1da5b9-f454-4dc9-b965-2c88c83a03b9 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1522 microversion: 2.1 time: 0.221155 May 26 18:02:42.809257 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 84/167] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:42 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:43.038687 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-effbf8b3-8593-4fc9-aead-f6ed3328dc50 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:43.039314 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-effbf8b3-8593-4fc9-aead-f6ed3328dc50 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] [instance: cd2fb019-75ed-45ea-948b-64a627396f02] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:43.051548 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-effbf8b3-8593-4fc9-aead-f6ed3328dc50 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:43.052700 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-effbf8b3-8593-4fc9-aead-f6ed3328dc50 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:43.053791 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-effbf8b3-8593-4fc9-aead-f6ed3328dc50 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:43.054379 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-effbf8b3-8593-4fc9-aead-f6ed3328dc50 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:43.153116 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-effbf8b3-8593-4fc9-aead-f6ed3328dc50 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b8f37c287341848d8d3b4d5f62873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fdf6152e6874f78825e5eddb7f14158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:43.162968 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-effbf8b3-8593-4fc9-aead-f6ed3328dc50 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] 10.222.0.69 "GET /compute/v2.1/servers/cd2fb019-75ed-45ea-948b-64a627396f02" status: 200 len: 1271 microversion: 2.1 time: 0.127679 May 26 18:02:43.174683 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 84/168] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:43 2022] GET /compute/v2.1/servers/cd2fb019-75ed-45ea-948b-64a627396f02 => generated 1271 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:43.817188 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-c535eee7-5e8c-430e-adbb-b434ff9c5c59 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:43.818410 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-c535eee7-5e8c-430e-adbb-b434ff9c5c59 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:43.824979 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c535eee7-5e8c-430e-adbb-b434ff9c5c59 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:43.825424 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c535eee7-5e8c-430e-adbb-b434ff9c5c59 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:43.826215 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c535eee7-5e8c-430e-adbb-b434ff9c5c59 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:43.826780 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c535eee7-5e8c-430e-adbb-b434ff9c5c59 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:43.922905 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-43e2e85a-cd7c-4734-8dc2-d74475450a68 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Action: 'create', calling method: .version_select at 0x7f3ab8e8c310>, body: {"keypair": {"name": "tempest-keypair-689133379", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEF+xRMmfrAk29tDz5SCgCgWu+hymWwl2Pz07yKc9tT/0cNZbpejv7WJKGSajpbCRruDOHz+An7TLh6GwvSK1M4KXvjtarz9YlAKA+96iPyD0bJb4bn3SgknNdbXVTIxCg=="}} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:02:43.937318 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.quota [None req-43e2e85a-cd7c-4734-8dc2-d74475450a68 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Getting quotas for project 8920d2de9dc34386bb0e770f5b51b702. Resources: {'key_pairs'} {{(pid=117722) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:02:43.941395 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.quota [None req-43e2e85a-cd7c-4734-8dc2-d74475450a68 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Getting quotas for user 2691e1dc96e942b5ba4c726b72a835e9 and project 8920d2de9dc34386bb0e770f5b51b702. Resources: {'key_pairs'} {{(pid=117722) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:02:43.964739 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-43e2e85a-cd7c-4734-8dc2-d74475450a68 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.176012 May 26 18:02:43.965402 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 85/169] 10.222.0.69 () {60 vars in 1158 bytes} [Thu May 26 18:02:43 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:02:44.041198 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-c535eee7-5e8c-430e-adbb-b434ff9c5c59 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:44.053681 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-c535eee7-5e8c-430e-adbb-b434ff9c5c59 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1522 microversion: 2.1 time: 0.241696 May 26 18:02:44.054600 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 85/170] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:43 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:02:44.182641 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-d627ad4f-2e42-4817-846b-f6fedb8dea7d tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:44.183446 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-d627ad4f-2e42-4817-846b-f6fedb8dea7d tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] [instance: cd2fb019-75ed-45ea-948b-64a627396f02] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:44.192700 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d627ad4f-2e42-4817-846b-f6fedb8dea7d tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:44.193508 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d627ad4f-2e42-4817-846b-f6fedb8dea7d tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:44.194592 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d627ad4f-2e42-4817-846b-f6fedb8dea7d tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:44.195244 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d627ad4f-2e42-4817-846b-f6fedb8dea7d tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:44.437364 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-d627ad4f-2e42-4817-846b-f6fedb8dea7d tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b8f37c287341848d8d3b4d5f62873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fdf6152e6874f78825e5eddb7f14158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:44.449791 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-d627ad4f-2e42-4817-846b-f6fedb8dea7d tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] 10.222.0.69 "GET /compute/v2.1/servers/cd2fb019-75ed-45ea-948b-64a627396f02" status: 200 len: 1319 microversion: 2.1 time: 0.272102 May 26 18:02:44.451124 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 86/171] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:44 2022] GET /compute/v2.1/servers/cd2fb019-75ed-45ea-948b-64a627396f02 => generated 1319 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:45.070672 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-b2a31a61-87f8-4782-afb2-34248763567c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:45.071859 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-b2a31a61-87f8-4782-afb2-34248763567c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:45.077544 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_api:SELECT=52 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:45.080372 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b2a31a61-87f8-4782-afb2-34248763567c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:45.081189 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b2a31a61-87f8-4782-afb2-34248763567c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:45.082793 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b2a31a61-87f8-4782-afb2-34248763567c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:45.083574 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b2a31a61-87f8-4782-afb2-34248763567c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:45.112121 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [req-fb173fa6-106f-45a4-8e0d-42c8a511d807 req-650786e5-cb2c-4617-bec1-4ae4e03e0285 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd2fb019-75ed-45ea-948b-64a627396f02", "tag": "e0546b1b-f912-4448-b796-b315d44f6acb"}]} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:02:45.137770 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-fb173fa6-106f-45a4-8e0d-42c8a511d807 req-650786e5-cb2c-4617-bec1-4ae4e03e0285 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:45.144160 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-fb173fa6-106f-45a4-8e0d-42c8a511d807 req-650786e5-cb2c-4617-bec1-4ae4e03e0285 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:45.179268 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.compute.server_external_events [req-fb173fa6-106f-45a4-8e0d-42c8a511d807 req-650786e5-cb2c-4617-bec1-4ae4e03e0285 service nova] Creating event network-changed:e0546b1b-f912-4448-b796-b315d44f6acb for instance cd2fb019-75ed-45ea-948b-64a627396f02 on hv-cinder-83607 May 26 18:02:45.193631 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [req-fb173fa6-106f-45a4-8e0d-42c8a511d807 req-650786e5-cb2c-4617-bec1-4ae4e03e0285 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087548 May 26 18:02:45.194253 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 87/172] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:02:45.470692 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-670e3655-de38-45e9-b40f-92222182fcca tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:45.472104 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-670e3655-de38-45e9-b40f-92222182fcca tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] [instance: cd2fb019-75ed-45ea-948b-64a627396f02] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:45.484590 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-670e3655-de38-45e9-b40f-92222182fcca tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:45.489046 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-670e3655-de38-45e9-b40f-92222182fcca tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:45.493838 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-670e3655-de38-45e9-b40f-92222182fcca tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:45.494834 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-670e3655-de38-45e9-b40f-92222182fcca tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:45.529708 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-b2a31a61-87f8-4782-afb2-34248763567c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:45.549076 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-b2a31a61-87f8-4782-afb2-34248763567c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1522 microversion: 2.1 time: 0.475697 May 26 18:02:45.560665 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 86/173] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:45 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1522 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:45.824598 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-670e3655-de38-45e9-b40f-92222182fcca tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b8f37c287341848d8d3b4d5f62873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fdf6152e6874f78825e5eddb7f14158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:45.834754 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-670e3655-de38-45e9-b40f-92222182fcca tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] 10.222.0.69 "GET /compute/v2.1/servers/cd2fb019-75ed-45ea-948b-64a627396f02" status: 200 len: 1319 microversion: 2.1 time: 0.369757 May 26 18:02:45.841809 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 88/174] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:45 2022] GET /compute/v2.1/servers/cd2fb019-75ed-45ea-948b-64a627396f02 => generated 1319 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:45.993683 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-f1f0f5bf-1ae4-4381-97d0-8b5351218c8f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1021908863", "imageRef": "16351c96-cb02-4711-99d5-fd4d80e8a846", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "481c535b-a9e7-4c84-8151-52762a8d6376"}], "security_groups": [{"name": "tempest-securitygroup--2049635031"}], "key_name": "tempest-keypair-689133379", "user_data": "}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:02:46.142007 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.network.neutron [None req-f1f0f5bf-1ae4-4381-97d0-8b5351218c8f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] validate_networks() for [('481c535b-a9e7-4c84-8151-52762a8d6376', None, None, None, None, None)] {{(pid=117723) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:02:46.571967 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-7016dc0c-55a5-4b7a-99b0-897ea2f69878 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:46.573423 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-7016dc0c-55a5-4b7a-99b0-897ea2f69878 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:46.584157 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7016dc0c-55a5-4b7a-99b0-897ea2f69878 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:46.584977 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7016dc0c-55a5-4b7a-99b0-897ea2f69878 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:46.586478 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7016dc0c-55a5-4b7a-99b0-897ea2f69878 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:46.586652 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-f1f0f5bf-1ae4-4381-97d0-8b5351218c8f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Flavor limits 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:02:46.587215 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-f1f0f5bf-1ae4-4381-97d0-8b5351218c8f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Image limits 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:02:46.587449 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7016dc0c-55a5-4b7a-99b0-897ea2f69878 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:46.587928 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-f1f0f5bf-1ae4-4381-97d0-8b5351218c8f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Flavor pref 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:02:46.588463 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-f1f0f5bf-1ae4-4381-97d0-8b5351218c8f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Image pref 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:02:46.588977 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-f1f0f5bf-1ae4-4381-97d0-8b5351218c8f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:02:46.615499 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f1f0f5bf-1ae4-4381-97d0-8b5351218c8f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:46.616171 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f1f0f5bf-1ae4-4381-97d0-8b5351218c8f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:46.617201 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f1f0f5bf-1ae4-4381-97d0-8b5351218c8f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:46.617817 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f1f0f5bf-1ae4-4381-97d0-8b5351218c8f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:46.649239 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-f1f0f5bf-1ae4-4381-97d0-8b5351218c8f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Getting quotas for project 8920d2de9dc34386bb0e770f5b51b702. Resources: {'instances', 'ram', 'cores'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:02:46.657838 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-f1f0f5bf-1ae4-4381-97d0-8b5351218c8f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Getting quotas for user 2691e1dc96e942b5ba4c726b72a835e9 and project 8920d2de9dc34386bb0e770f5b51b702. Resources: {'instances', 'ram', 'cores'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:02:46.680001 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-f1f0f5bf-1ae4-4381-97d0-8b5351218c8f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Going to run 1 instances... {{(pid=117723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:02:46.685470 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-f1f0f5bf-1ae4-4381-97d0-8b5351218c8f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='16351c96-cb02-4711-99d5-fd4d80e8a846',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:02:46.766022 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-f1f0f5bf-1ae4-4381-97d0-8b5351218c8f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.787194 May 26 18:02:46.766728 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 87/175] 10.222.0.69 () {60 vars in 1146 bytes} [Thu May 26 18:02:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 18:02:46.778502 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-2bc0cf78-0f77-4d13-b008-9654202db216 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:46.779324 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-2bc0cf78-0f77-4d13-b008-9654202db216 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:46.798172 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-7016dc0c-55a5-4b7a-99b0-897ea2f69878 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:46.809450 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-7016dc0c-55a5-4b7a-99b0-897ea2f69878 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1522 microversion: 2.1 time: 0.245385 May 26 18:02:46.810131 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 89/176] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:46 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:46.855366 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-2bc0cf78-0f77-4d13-b008-9654202db216 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:46.863542 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-d47a0d24-3f58-4b1e-828c-c0c5ddc1aa84 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:46.864100 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-2bc0cf78-0f77-4d13-b008-9654202db216 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7" status: 200 len: 1241 microversion: 2.1 time: 0.090949 May 26 18:02:46.864234 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-d47a0d24-3f58-4b1e-828c-c0c5ddc1aa84 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] [instance: cd2fb019-75ed-45ea-948b-64a627396f02] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:46.875262 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 88/177] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:46 2022] GET /compute/v2.1/servers/fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7 => generated 1241 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:02:46.878803 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d47a0d24-3f58-4b1e-828c-c0c5ddc1aa84 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:46.879475 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d47a0d24-3f58-4b1e-828c-c0c5ddc1aa84 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:46.880482 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d47a0d24-3f58-4b1e-828c-c0c5ddc1aa84 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:46.881223 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d47a0d24-3f58-4b1e-828c-c0c5ddc1aa84 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:47.073703 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-d47a0d24-3f58-4b1e-828c-c0c5ddc1aa84 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b8f37c287341848d8d3b4d5f62873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fdf6152e6874f78825e5eddb7f14158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:47.085580 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-d47a0d24-3f58-4b1e-828c-c0c5ddc1aa84 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] 10.222.0.69 "GET /compute/v2.1/servers/cd2fb019-75ed-45ea-948b-64a627396f02" status: 200 len: 1319 microversion: 2.1 time: 0.230299 May 26 18:02:47.086689 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 90/178] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:46 2022] GET /compute/v2.1/servers/cd2fb019-75ed-45ea-948b-64a627396f02 => generated 1319 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:47.827121 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-cdd83827-8c6c-49c0-8aaa-e967a8a00b52 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:47.827812 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-cdd83827-8c6c-49c0-8aaa-e967a8a00b52 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:47.834558 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-cdd83827-8c6c-49c0-8aaa-e967a8a00b52 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:47.835009 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-cdd83827-8c6c-49c0-8aaa-e967a8a00b52 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:47.835800 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-cdd83827-8c6c-49c0-8aaa-e967a8a00b52 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:47.836427 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-cdd83827-8c6c-49c0-8aaa-e967a8a00b52 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:47.881532 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-283ef8a9-bde4-405a-b879-e6d5c0ef35b6 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:47.882435 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-283ef8a9-bde4-405a-b879-e6d5c0ef35b6 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:47.889706 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-283ef8a9-bde4-405a-b879-e6d5c0ef35b6 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:47.890526 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-283ef8a9-bde4-405a-b879-e6d5c0ef35b6 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:47.891458 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-283ef8a9-bde4-405a-b879-e6d5c0ef35b6 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:47.892004 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-283ef8a9-bde4-405a-b879-e6d5c0ef35b6 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:47.958857 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-283ef8a9-bde4-405a-b879-e6d5c0ef35b6 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:47.967013 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-283ef8a9-bde4-405a-b879-e6d5c0ef35b6 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7" status: 200 len: 1293 microversion: 2.1 time: 0.089352 May 26 18:02:47.967768 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 91/179] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:47 2022] GET /compute/v2.1/servers/fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7 => generated 1293 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:02:47.979609 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-cdd83827-8c6c-49c0-8aaa-e967a8a00b52 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:47.988751 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-cdd83827-8c6c-49c0-8aaa-e967a8a00b52 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1522 microversion: 2.1 time: 0.165782 May 26 18:02:47.989345 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 89/180] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:47 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:48.102662 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-a6ecbaf4-95e7-4a2a-b4d2-08638f207422 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:48.103348 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-a6ecbaf4-95e7-4a2a-b4d2-08638f207422 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] [instance: cd2fb019-75ed-45ea-948b-64a627396f02] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:48.110414 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-a6ecbaf4-95e7-4a2a-b4d2-08638f207422 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:48.110867 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-a6ecbaf4-95e7-4a2a-b4d2-08638f207422 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:48.111661 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-a6ecbaf4-95e7-4a2a-b4d2-08638f207422 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:48.112233 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-a6ecbaf4-95e7-4a2a-b4d2-08638f207422 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:48.260749 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-a6ecbaf4-95e7-4a2a-b4d2-08638f207422 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b8f37c287341848d8d3b4d5f62873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fdf6152e6874f78825e5eddb7f14158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:48.276769 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-a6ecbaf4-95e7-4a2a-b4d2-08638f207422 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] 10.222.0.69 "GET /compute/v2.1/servers/cd2fb019-75ed-45ea-948b-64a627396f02" status: 200 len: 1319 microversion: 2.1 time: 0.178009 May 26 18:02:48.277532 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 92/181] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:48 2022] GET /compute/v2.1/servers/cd2fb019-75ed-45ea-948b-64a627396f02 => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:48.986362 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-36064cf3-72be-447a-b0ec-cae99a5d5641 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:48.986982 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-36064cf3-72be-447a-b0ec-cae99a5d5641 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:48.997954 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-36064cf3-72be-447a-b0ec-cae99a5d5641 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:48.998418 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-36064cf3-72be-447a-b0ec-cae99a5d5641 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:49.000814 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-36064cf3-72be-447a-b0ec-cae99a5d5641 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:49.001554 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-36064cf3-72be-447a-b0ec-cae99a5d5641 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:49.006561 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-c1ef391c-2b8a-4e4a-bdc4-c22644fa0125 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:49.018030 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-c1ef391c-2b8a-4e4a-bdc4-c22644fa0125 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:49.027907 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c1ef391c-2b8a-4e4a-bdc4-c22644fa0125 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:49.028578 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c1ef391c-2b8a-4e4a-bdc4-c22644fa0125 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:49.029680 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c1ef391c-2b8a-4e4a-bdc4-c22644fa0125 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:49.031374 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c1ef391c-2b8a-4e4a-bdc4-c22644fa0125 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:49.036297 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_cell1:SELECT=100 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:49.180400 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-c1ef391c-2b8a-4e4a-bdc4-c22644fa0125 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:49.189968 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-c1ef391c-2b8a-4e4a-bdc4-c22644fa0125 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1522 microversion: 2.1 time: 0.187608 May 26 18:02:49.190673 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 93/182] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:49 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:49.261314 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-36064cf3-72be-447a-b0ec-cae99a5d5641 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:49.269683 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-36064cf3-72be-447a-b0ec-cae99a5d5641 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7" status: 200 len: 1367 microversion: 2.1 time: 0.288136 May 26 18:02:49.270602 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 90/183] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:48 2022] GET /compute/v2.1/servers/fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7 => generated 1367 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:02:49.294285 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-1aed5af2-0ee0-462f-a0ad-4eedd3823cba tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:49.294909 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-1aed5af2-0ee0-462f-a0ad-4eedd3823cba tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] [instance: cd2fb019-75ed-45ea-948b-64a627396f02] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:49.301588 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-1aed5af2-0ee0-462f-a0ad-4eedd3823cba tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:49.302261 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-1aed5af2-0ee0-462f-a0ad-4eedd3823cba tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:49.303217 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-1aed5af2-0ee0-462f-a0ad-4eedd3823cba tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:49.303804 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-1aed5af2-0ee0-462f-a0ad-4eedd3823cba tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:49.455784 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-1aed5af2-0ee0-462f-a0ad-4eedd3823cba tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b8f37c287341848d8d3b4d5f62873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fdf6152e6874f78825e5eddb7f14158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:49.467101 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-1aed5af2-0ee0-462f-a0ad-4eedd3823cba tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] 10.222.0.69 "GET /compute/v2.1/servers/cd2fb019-75ed-45ea-948b-64a627396f02" status: 200 len: 1319 microversion: 2.1 time: 0.176569 May 26 18:02:49.467737 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 94/184] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:49 2022] GET /compute/v2.1/servers/cd2fb019-75ed-45ea-948b-64a627396f02 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:49.873850 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-4cb61b4f-c16e-4e36-9e87-c5d38c727111 req-132fb009-9dcb-44aa-a5e0-84d464e21683 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7", "tag": "ce4a9d70-264c-4cdc-a8ce-2911a9f3ec0c"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:02:49.885413 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-4cb61b4f-c16e-4e36-9e87-c5d38c727111 req-132fb009-9dcb-44aa-a5e0-84d464e21683 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:49.886368 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-4cb61b4f-c16e-4e36-9e87-c5d38c727111 req-132fb009-9dcb-44aa-a5e0-84d464e21683 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:49.905158 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-4cb61b4f-c16e-4e36-9e87-c5d38c727111 req-132fb009-9dcb-44aa-a5e0-84d464e21683 service nova] Creating event network-changed:ce4a9d70-264c-4cdc-a8ce-2911a9f3ec0c for instance fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7 on hv-cinder-83607 May 26 18:02:49.913592 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-4cb61b4f-c16e-4e36-9e87-c5d38c727111 req-132fb009-9dcb-44aa-a5e0-84d464e21683 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046323 May 26 18:02:49.917150 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 91/185] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:02:50.207883 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-67f23d1e-586d-42e8-ab55-a75aeed1c00b tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:50.208546 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-67f23d1e-586d-42e8-ab55-a75aeed1c00b tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:50.223861 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-67f23d1e-586d-42e8-ab55-a75aeed1c00b tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:50.224597 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-67f23d1e-586d-42e8-ab55-a75aeed1c00b tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:50.225571 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-67f23d1e-586d-42e8-ab55-a75aeed1c00b tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:50.226149 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-67f23d1e-586d-42e8-ab55-a75aeed1c00b tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:50.287418 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-0521ca37-f84b-4656-bc71-3dc03a668cde tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:50.288370 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-0521ca37-f84b-4656-bc71-3dc03a668cde tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:50.295617 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0521ca37-f84b-4656-bc71-3dc03a668cde tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:50.297351 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0521ca37-f84b-4656-bc71-3dc03a668cde tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:50.298208 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0521ca37-f84b-4656-bc71-3dc03a668cde tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:50.298712 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0521ca37-f84b-4656-bc71-3dc03a668cde tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:50.377667 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-67f23d1e-586d-42e8-ab55-a75aeed1c00b tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:50.387270 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-67f23d1e-586d-42e8-ab55-a75aeed1c00b tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1522 microversion: 2.1 time: 0.183529 May 26 18:02:50.387869 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 95/186] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:50 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:50.448909 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-0521ca37-f84b-4656-bc71-3dc03a668cde tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:50.457152 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-0521ca37-f84b-4656-bc71-3dc03a668cde tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7" status: 200 len: 1367 microversion: 2.1 time: 0.173909 May 26 18:02:50.457731 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 92/187] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:50 2022] GET /compute/v2.1/servers/fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:50.485598 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-da6322d0-a0f9-4ef6-be0c-b2672715cb83 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:50.486130 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-da6322d0-a0f9-4ef6-be0c-b2672715cb83 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] [instance: cd2fb019-75ed-45ea-948b-64a627396f02] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:50.492172 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-da6322d0-a0f9-4ef6-be0c-b2672715cb83 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:50.492619 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-da6322d0-a0f9-4ef6-be0c-b2672715cb83 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:50.493392 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-da6322d0-a0f9-4ef6-be0c-b2672715cb83 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:50.493826 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-da6322d0-a0f9-4ef6-be0c-b2672715cb83 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:50.624924 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-da6322d0-a0f9-4ef6-be0c-b2672715cb83 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b8f37c287341848d8d3b4d5f62873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fdf6152e6874f78825e5eddb7f14158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:50.632334 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-da6322d0-a0f9-4ef6-be0c-b2672715cb83 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] 10.222.0.69 "GET /compute/v2.1/servers/cd2fb019-75ed-45ea-948b-64a627396f02" status: 200 len: 1319 microversion: 2.1 time: 0.151504 May 26 18:02:50.632913 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 96/188] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:50 2022] GET /compute/v2.1/servers/cd2fb019-75ed-45ea-948b-64a627396f02 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:51.405030 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-43b54605-bbf7-450e-af4d-0d610536c190 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:51.406476 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-43b54605-bbf7-450e-af4d-0d610536c190 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:51.418759 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-43b54605-bbf7-450e-af4d-0d610536c190 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:51.419219 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-43b54605-bbf7-450e-af4d-0d610536c190 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:51.420250 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-43b54605-bbf7-450e-af4d-0d610536c190 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:51.421869 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-43b54605-bbf7-450e-af4d-0d610536c190 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:51.464306 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [req-3a7dce7a-b355-4048-8bfb-97e2ef61b183 req-79a5ecf4-7995-45bc-9809-a1fa7ba1a310 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd2fb019-75ed-45ea-948b-64a627396f02", "name": "network-vif-plugged", "status": "completed", "tag": "e0546b1b-f912-4448-b796-b315d44f6acb"}]} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:02:51.478363 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-3a7dce7a-b355-4048-8bfb-97e2ef61b183 req-79a5ecf4-7995-45bc-9809-a1fa7ba1a310 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:51.479140 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-3a7dce7a-b355-4048-8bfb-97e2ef61b183 req-79a5ecf4-7995-45bc-9809-a1fa7ba1a310 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:51.492773 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.compute.server_external_events [req-3a7dce7a-b355-4048-8bfb-97e2ef61b183 req-79a5ecf4-7995-45bc-9809-a1fa7ba1a310 service nova] Creating event network-vif-plugged:e0546b1b-f912-4448-b796-b315d44f6acb for instance cd2fb019-75ed-45ea-948b-64a627396f02 on hv-cinder-83607 May 26 18:02:51.499755 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [req-3a7dce7a-b355-4048-8bfb-97e2ef61b183 req-79a5ecf4-7995-45bc-9809-a1fa7ba1a310 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038818 May 26 18:02:51.500838 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 97/189] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:02:51.509463 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-57370a7d-5acf-45ed-b60a-b3fe06bbb783 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:51.510456 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-57370a7d-5acf-45ed-b60a-b3fe06bbb783 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:51.530002 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-57370a7d-5acf-45ed-b60a-b3fe06bbb783 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:51.531778 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-57370a7d-5acf-45ed-b60a-b3fe06bbb783 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:51.533130 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-57370a7d-5acf-45ed-b60a-b3fe06bbb783 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:51.533793 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-57370a7d-5acf-45ed-b60a-b3fe06bbb783 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:51.732799 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-57370a7d-5acf-45ed-b60a-b3fe06bbb783 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:51.741901 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-57370a7d-5acf-45ed-b60a-b3fe06bbb783 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7" status: 200 len: 1367 microversion: 2.1 time: 0.239395 May 26 18:02:51.742602 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 98/190] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:51 2022] GET /compute/v2.1/servers/fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7 => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:51.747457 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-07cf3e5f-1321-4c88-9c3d-5d361d2e53c8 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:51.748313 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-07cf3e5f-1321-4c88-9c3d-5d361d2e53c8 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] [instance: cd2fb019-75ed-45ea-948b-64a627396f02] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:51.755453 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-07cf3e5f-1321-4c88-9c3d-5d361d2e53c8 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:51.756214 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-07cf3e5f-1321-4c88-9c3d-5d361d2e53c8 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:51.757245 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-07cf3e5f-1321-4c88-9c3d-5d361d2e53c8 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:51.757884 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-07cf3e5f-1321-4c88-9c3d-5d361d2e53c8 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:51.763846 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_cell0:SELECT=2 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:51.815082 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-43b54605-bbf7-450e-af4d-0d610536c190 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:51.828082 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-43b54605-bbf7-450e-af4d-0d610536c190 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1522 microversion: 2.1 time: 0.425749 May 26 18:02:51.838594 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 93/191] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:51 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1522 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:51.928226 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-07cf3e5f-1321-4c88-9c3d-5d361d2e53c8 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b8f37c287341848d8d3b4d5f62873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fdf6152e6874f78825e5eddb7f14158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:51.936273 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-07cf3e5f-1321-4c88-9c3d-5d361d2e53c8 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] 10.222.0.69 "GET /compute/v2.1/servers/cd2fb019-75ed-45ea-948b-64a627396f02" status: 200 len: 1319 microversion: 2.1 time: 0.192227 May 26 18:02:51.938326 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 99/192] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:51 2022] GET /compute/v2.1/servers/cd2fb019-75ed-45ea-948b-64a627396f02 => generated 1319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:52.769171 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-c99d7ccf-d9a2-40f5-a9b2-6f1b85e8938a tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:52.769779 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-c99d7ccf-d9a2-40f5-a9b2-6f1b85e8938a tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:52.783192 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c99d7ccf-d9a2-40f5-a9b2-6f1b85e8938a tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:52.783534 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c99d7ccf-d9a2-40f5-a9b2-6f1b85e8938a tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:52.784439 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c99d7ccf-d9a2-40f5-a9b2-6f1b85e8938a tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:52.784881 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c99d7ccf-d9a2-40f5-a9b2-6f1b85e8938a tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:52.847223 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-813f3e91-c0b6-4116-b5c5-51d62bf5d4c0 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:52.847748 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-813f3e91-c0b6-4116-b5c5-51d62bf5d4c0 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:52.854760 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-813f3e91-c0b6-4116-b5c5-51d62bf5d4c0 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:52.855481 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-813f3e91-c0b6-4116-b5c5-51d62bf5d4c0 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:52.856421 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-813f3e91-c0b6-4116-b5c5-51d62bf5d4c0 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:52.857638 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-813f3e91-c0b6-4116-b5c5-51d62bf5d4c0 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:53.004835 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-c99d7ccf-d9a2-40f5-a9b2-6f1b85e8938a tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:53.019302 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-c99d7ccf-d9a2-40f5-a9b2-6f1b85e8938a tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7" status: 200 len: 1367 microversion: 2.1 time: 0.253094 May 26 18:02:53.021534 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 94/193] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:52 2022] GET /compute/v2.1/servers/fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7 => generated 1367 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:53.026898 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-f21dfdbf-cf40-4a0e-84d2-0f223933f70e tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:53.027742 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-f21dfdbf-cf40-4a0e-84d2-0f223933f70e tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] [instance: cd2fb019-75ed-45ea-948b-64a627396f02] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:53.040220 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f21dfdbf-cf40-4a0e-84d2-0f223933f70e tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:53.040823 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f21dfdbf-cf40-4a0e-84d2-0f223933f70e tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:53.041714 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f21dfdbf-cf40-4a0e-84d2-0f223933f70e tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:53.042300 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f21dfdbf-cf40-4a0e-84d2-0f223933f70e tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:53.059903 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-813f3e91-c0b6-4116-b5c5-51d62bf5d4c0 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:53.069946 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-813f3e91-c0b6-4116-b5c5-51d62bf5d4c0 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1522 microversion: 2.1 time: 0.229007 May 26 18:02:53.071221 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 100/194] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:52 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:02:53.217337 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-f21dfdbf-cf40-4a0e-84d2-0f223933f70e tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b8f37c287341848d8d3b4d5f62873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fdf6152e6874f78825e5eddb7f14158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:53.226865 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-f21dfdbf-cf40-4a0e-84d2-0f223933f70e tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] 10.222.0.69 "GET /compute/v2.1/servers/cd2fb019-75ed-45ea-948b-64a627396f02" status: 200 len: 1319 microversion: 2.1 time: 0.203933 May 26 18:02:53.227600 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 95/195] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:53 2022] GET /compute/v2.1/servers/cd2fb019-75ed-45ea-948b-64a627396f02 => generated 1319 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:54.041021 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-bb1122c9-d692-4fb0-8ca2-49663cff2b26 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:54.043148 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-bb1122c9-d692-4fb0-8ca2-49663cff2b26 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:54.045945 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_cell0:SELECT=10 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:54.051867 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-bb1122c9-d692-4fb0-8ca2-49663cff2b26 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:54.052588 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-bb1122c9-d692-4fb0-8ca2-49663cff2b26 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:54.053727 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-bb1122c9-d692-4fb0-8ca2-49663cff2b26 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:54.054316 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-bb1122c9-d692-4fb0-8ca2-49663cff2b26 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:54.089695 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-ea78704e-8692-44b1-97e2-de596278c1de tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:54.090544 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-ea78704e-8692-44b1-97e2-de596278c1de tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:54.101950 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ea78704e-8692-44b1-97e2-de596278c1de tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:54.104806 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ea78704e-8692-44b1-97e2-de596278c1de tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:54.113969 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ea78704e-8692-44b1-97e2-de596278c1de tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:54.114792 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ea78704e-8692-44b1-97e2-de596278c1de tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:54.241547 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-bb1122c9-d692-4fb0-8ca2-49663cff2b26 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:54.252630 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-bb1122c9-d692-4fb0-8ca2-49663cff2b26 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7" status: 200 len: 1367 microversion: 2.1 time: 0.217238 May 26 18:02:54.260509 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 101/196] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:54 2022] GET /compute/v2.1/servers/fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7 => generated 1367 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:54.280051 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-7be2af75-d53e-4d4e-999a-42fdc1c454e4 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:54.281727 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-7be2af75-d53e-4d4e-999a-42fdc1c454e4 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] [instance: cd2fb019-75ed-45ea-948b-64a627396f02] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:54.289753 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7be2af75-d53e-4d4e-999a-42fdc1c454e4 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:54.290213 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7be2af75-d53e-4d4e-999a-42fdc1c454e4 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:54.291410 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7be2af75-d53e-4d4e-999a-42fdc1c454e4 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:54.292789 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7be2af75-d53e-4d4e-999a-42fdc1c454e4 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:54.304912 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-ea78704e-8692-44b1-97e2-de596278c1de tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:54.314633 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-ea78704e-8692-44b1-97e2-de596278c1de tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1522 microversion: 2.1 time: 0.229495 May 26 18:02:54.326985 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 96/197] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:54 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:02:54.451239 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-7be2af75-d53e-4d4e-999a-42fdc1c454e4 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b8f37c287341848d8d3b4d5f62873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fdf6152e6874f78825e5eddb7f14158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:54.461395 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-7be2af75-d53e-4d4e-999a-42fdc1c454e4 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] 10.222.0.69 "GET /compute/v2.1/servers/cd2fb019-75ed-45ea-948b-64a627396f02" status: 200 len: 1509 microversion: 2.1 time: 0.199043 May 26 18:02:54.463681 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 102/198] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:54 2022] GET /compute/v2.1/servers/cd2fb019-75ed-45ea-948b-64a627396f02 => generated 1509 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:55.270756 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-56f4e3fe-a287-431f-b193-49f1905901a4 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:55.271494 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-56f4e3fe-a287-431f-b193-49f1905901a4 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:55.277837 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-56f4e3fe-a287-431f-b193-49f1905901a4 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:55.278292 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-56f4e3fe-a287-431f-b193-49f1905901a4 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:55.279095 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-56f4e3fe-a287-431f-b193-49f1905901a4 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:55.279526 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-56f4e3fe-a287-431f-b193-49f1905901a4 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:55.336514 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-94867bf6-5a4b-439d-88f1-e012b031b652 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:55.338882 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-94867bf6-5a4b-439d-88f1-e012b031b652 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:55.362835 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-94867bf6-5a4b-439d-88f1-e012b031b652 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:55.365359 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-94867bf6-5a4b-439d-88f1-e012b031b652 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:55.366356 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-94867bf6-5a4b-439d-88f1-e012b031b652 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:55.367066 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-94867bf6-5a4b-439d-88f1-e012b031b652 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:55.433760 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-56f4e3fe-a287-431f-b193-49f1905901a4 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:55.442480 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-56f4e3fe-a287-431f-b193-49f1905901a4 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7" status: 200 len: 1367 microversion: 2.1 time: 0.176165 May 26 18:02:55.443270 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 97/199] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:55 2022] GET /compute/v2.1/servers/fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7 => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:55.505613 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-7bf5ab24-b069-4e6d-bcef-be49adfb1262 req-9939403d-8af5-4f7f-a7be-a15407e51b6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7", "name": "network-vif-plugged", "status": "completed", "tag": "ce4a9d70-264c-4cdc-a8ce-2911a9f3ec0c"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:02:55.514225 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-7bf5ab24-b069-4e6d-bcef-be49adfb1262 req-9939403d-8af5-4f7f-a7be-a15407e51b6c service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:55.515386 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-7bf5ab24-b069-4e6d-bcef-be49adfb1262 req-9939403d-8af5-4f7f-a7be-a15407e51b6c service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:55.528652 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-7bf5ab24-b069-4e6d-bcef-be49adfb1262 req-9939403d-8af5-4f7f-a7be-a15407e51b6c service nova] Creating event network-vif-plugged:ce4a9d70-264c-4cdc-a8ce-2911a9f3ec0c for instance fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7 on hv-cinder-83607 May 26 18:02:55.534993 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-7bf5ab24-b069-4e6d-bcef-be49adfb1262 req-9939403d-8af5-4f7f-a7be-a15407e51b6c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033104 May 26 18:02:55.535902 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 98/200] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:02:55.571035 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-94867bf6-5a4b-439d-88f1-e012b031b652 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:55.591900 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-94867bf6-5a4b-439d-88f1-e012b031b652 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1522 microversion: 2.1 time: 0.261359 May 26 18:02:55.593175 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 103/201] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:55 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:02:56.043499 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-03c14cf0-82ea-4915-9db6-2ad9df8491b0 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1789724835", "imageRef": "16351c96-cb02-4711-99d5-fd4d80e8a846", "flavorRef": "452"}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:02:56.460232 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-325b34f5-2bf9-46be-b9bb-f8862aa1ad9b tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:56.460854 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-325b34f5-2bf9-46be-b9bb-f8862aa1ad9b tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:56.468356 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-325b34f5-2bf9-46be-b9bb-f8862aa1ad9b tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:56.468811 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-325b34f5-2bf9-46be-b9bb-f8862aa1ad9b tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:56.469603 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-325b34f5-2bf9-46be-b9bb-f8862aa1ad9b tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:56.470049 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-325b34f5-2bf9-46be-b9bb-f8862aa1ad9b tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:56.605858 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-325b34f5-2bf9-46be-b9bb-f8862aa1ad9b tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:56.614249 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-325b34f5-2bf9-46be-b9bb-f8862aa1ad9b tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7" status: 200 len: 1367 microversion: 2.1 time: 0.158072 May 26 18:02:56.614816 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 104/202] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:56 2022] GET /compute/v2.1/servers/fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:56.619171 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-f71db5bb-1aac-4fec-8ca8-a677ab38f383 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:56.619775 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-f71db5bb-1aac-4fec-8ca8-a677ab38f383 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:56.627206 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-f71db5bb-1aac-4fec-8ca8-a677ab38f383 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:56.627659 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-f71db5bb-1aac-4fec-8ca8-a677ab38f383 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:56.628576 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-f71db5bb-1aac-4fec-8ca8-a677ab38f383 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:56.628693 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell0:SELECT=2 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:56.629147 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-f71db5bb-1aac-4fec-8ca8-a677ab38f383 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:56.764663 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-f71db5bb-1aac-4fec-8ca8-a677ab38f383 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:56.773355 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-f71db5bb-1aac-4fec-8ca8-a677ab38f383 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1522 microversion: 2.1 time: 0.157502 May 26 18:02:56.773948 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 105/203] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:56 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:56.860881 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell0:SELECT=10 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:57.631701 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-305c7651-83c2-479d-858c-5d58bd394200 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:57.632716 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-305c7651-83c2-479d-858c-5d58bd394200 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:57.640043 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-305c7651-83c2-479d-858c-5d58bd394200 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:57.640511 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-305c7651-83c2-479d-858c-5d58bd394200 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:57.641425 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-305c7651-83c2-479d-858c-5d58bd394200 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:57.641865 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-305c7651-83c2-479d-858c-5d58bd394200 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:57.777850 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-305c7651-83c2-479d-858c-5d58bd394200 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:57.786221 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-305c7651-83c2-479d-858c-5d58bd394200 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7" status: 200 len: 1557 microversion: 2.1 time: 0.158623 May 26 18:02:57.786803 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 106/204] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:57 2022] GET /compute/v2.1/servers/fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7 => generated 1557 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:02:57.791238 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-1939ef69-c85f-4379-8cb8-0a1e3512b43a tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:57.791842 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-1939ef69-c85f-4379-8cb8-0a1e3512b43a tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:57.798109 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-1939ef69-c85f-4379-8cb8-0a1e3512b43a tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:57.798561 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-1939ef69-c85f-4379-8cb8-0a1e3512b43a tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:57.799345 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-1939ef69-c85f-4379-8cb8-0a1e3512b43a tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:57.799780 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-1939ef69-c85f-4379-8cb8-0a1e3512b43a tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:57.942381 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-1939ef69-c85f-4379-8cb8-0a1e3512b43a tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:57.950340 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-1939ef69-c85f-4379-8cb8-0a1e3512b43a tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1522 microversion: 2.1 time: 0.162544 May 26 18:02:57.950930 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 107/205] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:57 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:57.956694 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-9719857d-f737-443b-bc12-43f1d8185e8a tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:57.957441 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-9719857d-f737-443b-bc12-43f1d8185e8a tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:57.966325 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-9719857d-f737-443b-bc12-43f1d8185e8a tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:57.966644 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-9719857d-f737-443b-bc12-43f1d8185e8a tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:57.967874 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-9719857d-f737-443b-bc12-43f1d8185e8a tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:57.968567 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-9719857d-f737-443b-bc12-43f1d8185e8a tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:58.057325 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-9719857d-f737-443b-bc12-43f1d8185e8a tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.105313 May 26 18:02:58.057963 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 108/206] 10.222.0.69 () {58 vars in 1274 bytes} [Thu May 26 18:02:57 2022] GET /compute/v2.1/servers/fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:02:58.971028 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-2217a108-4539-41c9-9232-481345ae70c2 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:58.971677 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-2217a108-4539-41c9-9232-481345ae70c2 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:58.977940 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-2217a108-4539-41c9-9232-481345ae70c2 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:58.978385 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-2217a108-4539-41c9-9232-481345ae70c2 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:58.979227 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-2217a108-4539-41c9-9232-481345ae70c2 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:58.979602 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-2217a108-4539-41c9-9232-481345ae70c2 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:59.174462 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-2217a108-4539-41c9-9232-481345ae70c2 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:59.182106 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-2217a108-4539-41c9-9232-481345ae70c2 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1522 microversion: 2.1 time: 0.216146 May 26 18:02:59.182991 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 109/207] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:02:58 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:02:59.332779 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [req-a439a6c5-81bc-4953-bed0-2f2500dc14ad req-de354a50-3d88-4a06-98fc-a8659c241360 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7", "tag": "ce4a9d70-264c-4cdc-a8ce-2911a9f3ec0c"}]} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:02:59.341898 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-a439a6c5-81bc-4953-bed0-2f2500dc14ad req-de354a50-3d88-4a06-98fc-a8659c241360 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:59.342622 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-a439a6c5-81bc-4953-bed0-2f2500dc14ad req-de354a50-3d88-4a06-98fc-a8659c241360 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:59.355500 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.compute.server_external_events [req-a439a6c5-81bc-4953-bed0-2f2500dc14ad req-de354a50-3d88-4a06-98fc-a8659c241360 service nova] Creating event network-changed:ce4a9d70-264c-4cdc-a8ce-2911a9f3ec0c for instance fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7 on hv-cinder-83607 May 26 18:02:59.361225 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [req-a439a6c5-81bc-4953-bed0-2f2500dc14ad req-de354a50-3d88-4a06-98fc-a8659c241360 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032114 May 26 18:02:59.362200 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 110/208] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:03:00.200282 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-5559d244-68f2-411b-b2f8-9e985fc01fc7 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:00.201287 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-5559d244-68f2-411b-b2f8-9e985fc01fc7 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:00.209242 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-5559d244-68f2-411b-b2f8-9e985fc01fc7 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:00.209702 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-5559d244-68f2-411b-b2f8-9e985fc01fc7 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:00.210508 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-5559d244-68f2-411b-b2f8-9e985fc01fc7 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:00.210955 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-5559d244-68f2-411b-b2f8-9e985fc01fc7 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:00.228622 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_cell1:SELECT=100 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:03:00.361666 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-5559d244-68f2-411b-b2f8-9e985fc01fc7 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:00.370070 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-5559d244-68f2-411b-b2f8-9e985fc01fc7 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1522 microversion: 2.1 time: 0.174080 May 26 18:03:00.370578 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 111/209] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:00 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:03:00.708047 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-30b2b42c-8045-4c0b-9b32-29d92db41fb2 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:00.708571 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-30b2b42c-8045-4c0b-9b32-29d92db41fb2 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:00.715096 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-30b2b42c-8045-4c0b-9b32-29d92db41fb2 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:00.715543 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-30b2b42c-8045-4c0b-9b32-29d92db41fb2 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:00.716367 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-30b2b42c-8045-4c0b-9b32-29d92db41fb2 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:00.716806 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-30b2b42c-8045-4c0b-9b32-29d92db41fb2 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:00.744264 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-30b2b42c-8045-4c0b-9b32-29d92db41fb2 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1/ips" status: 200 len: 152 microversion: 2.20 time: 0.040430 May 26 18:03:00.744908 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 112/210] 10.222.0.69 () {60 vars in 1288 bytes} [Thu May 26 18:03:00 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1/ips => generated 152 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 18:03:01.386810 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-bee79e83-9939-4067-8ac4-f25b04328dca tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:01.387476 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-bee79e83-9939-4067-8ac4-f25b04328dca tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:01.394245 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-bee79e83-9939-4067-8ac4-f25b04328dca tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:01.394698 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-bee79e83-9939-4067-8ac4-f25b04328dca tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:01.395479 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-bee79e83-9939-4067-8ac4-f25b04328dca tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:01.395912 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-bee79e83-9939-4067-8ac4-f25b04328dca tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:01.536380 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-bee79e83-9939-4067-8ac4-f25b04328dca tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:01.544054 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-bee79e83-9939-4067-8ac4-f25b04328dca tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1522 microversion: 2.1 time: 0.161222 May 26 18:03:01.544663 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 113/211] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:01 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:03:02.563843 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-7e4e60fd-8f94-4796-8c43-895723bbaf6e tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:02.564578 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-7e4e60fd-8f94-4796-8c43-895723bbaf6e tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:02.571169 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7e4e60fd-8f94-4796-8c43-895723bbaf6e tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:02.571630 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7e4e60fd-8f94-4796-8c43-895723bbaf6e tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:02.572450 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7e4e60fd-8f94-4796-8c43-895723bbaf6e tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:02.572895 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7e4e60fd-8f94-4796-8c43-895723bbaf6e tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:02.707611 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-7e4e60fd-8f94-4796-8c43-895723bbaf6e tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:02.718413 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-7e4e60fd-8f94-4796-8c43-895723bbaf6e tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1522 microversion: 2.1 time: 0.158386 May 26 18:03:02.719056 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 114/212] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:02 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:03:03.089612 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-4e1e6e43-9bb4-4058-b14e-51a953cebfa8 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:03:03.090171 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-4e1e6e43-9bb4-4058-b14e-51a953cebfa8 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:03.098108 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-4e1e6e43-9bb4-4058-b14e-51a953cebfa8 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:03.098563 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-4e1e6e43-9bb4-4058-b14e-51a953cebfa8 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:03.099666 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-4e1e6e43-9bb4-4058-b14e-51a953cebfa8 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:03.100145 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-4e1e6e43-9bb4-4058-b14e-51a953cebfa8 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:03.125961 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.objects.instance [None req-4e1e6e43-9bb4-4058-b14e-51a953cebfa8 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lazy-loading 'flavor' on Instance uuid 262a4944-6c10-4122-adce-f7780ff4e7a1 {{(pid=117722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:03:05.521059 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=72 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:03:06.052362 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:03:12.163678 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.network.neutron [None req-03c14cf0-82ea-4915-9db6-2ad9df8491b0 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] validate_networks() for None {{(pid=117723) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:03:12.355251 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-4e1e6e43-9bb4-4058-b14e-51a953cebfa8 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "POST /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1/action" status: 202 len: 0 microversion: 2.20 time: 9.269401 May 26 18:03:12.360119 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 115/213] 10.222.0.69 () {62 vars in 1318 bytes} [Thu May 26 18:03:03 2022] POST /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1/action => generated 0 bytes in 9275 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 26 18:03:12.365763 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-ebb2a99b-feaf-4b99-a881-8029fb456b05 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:12.366391 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-ebb2a99b-feaf-4b99-a881-8029fb456b05 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:12.368405 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=4 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:03:12.380272 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ebb2a99b-feaf-4b99-a881-8029fb456b05 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:12.380682 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ebb2a99b-feaf-4b99-a881-8029fb456b05 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:12.382189 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ebb2a99b-feaf-4b99-a881-8029fb456b05 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:12.382189 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ebb2a99b-feaf-4b99-a881-8029fb456b05 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:12.534959 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-ebb2a99b-feaf-4b99-a881-8029fb456b05 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:12.542818 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-ebb2a99b-feaf-4b99-a881-8029fb456b05 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1522 microversion: 2.1 time: 0.181312 May 26 18:03:12.543424 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 116/214] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:12 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:12.548918 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-e84bf08f-53bc-4fa7-8254-e3ca2e20ffa6 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:12.549372 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-e84bf08f-53bc-4fa7-8254-e3ca2e20ffa6 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:12.559051 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e84bf08f-53bc-4fa7-8254-e3ca2e20ffa6 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:12.559407 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e84bf08f-53bc-4fa7-8254-e3ca2e20ffa6 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:12.560158 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e84bf08f-53bc-4fa7-8254-e3ca2e20ffa6 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:12.561170 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e84bf08f-53bc-4fa7-8254-e3ca2e20ffa6 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:12.663358 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-03c14cf0-82ea-4915-9db6-2ad9df8491b0 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Flavor limits 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:03:12.663911 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-03c14cf0-82ea-4915-9db6-2ad9df8491b0 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Image limits 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:03:12.664490 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-03c14cf0-82ea-4915-9db6-2ad9df8491b0 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Flavor pref 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:03:12.664883 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-03c14cf0-82ea-4915-9db6-2ad9df8491b0 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Image pref 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:03:12.665291 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-03c14cf0-82ea-4915-9db6-2ad9df8491b0 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:03:12.674771 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-03c14cf0-82ea-4915-9db6-2ad9df8491b0 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:12.675213 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-03c14cf0-82ea-4915-9db6-2ad9df8491b0 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:12.676052 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-03c14cf0-82ea-4915-9db6-2ad9df8491b0 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:12.676491 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-03c14cf0-82ea-4915-9db6-2ad9df8491b0 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:12.695558 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-03c14cf0-82ea-4915-9db6-2ad9df8491b0 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Getting quotas for project fbbc7667eb34449fb8ae5adb5916025d. Resources: {'instances', 'ram', 'cores'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:03:12.700008 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-03c14cf0-82ea-4915-9db6-2ad9df8491b0 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Getting quotas for user 7214f9024ca94bc892857a7296a727df and project fbbc7667eb34449fb8ae5adb5916025d. Resources: {'instances', 'ram', 'cores'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:03:12.708705 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-e84bf08f-53bc-4fa7-8254-e3ca2e20ffa6 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:12.721924 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-e84bf08f-53bc-4fa7-8254-e3ca2e20ffa6 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:12.723992 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-e84bf08f-53bc-4fa7-8254-e3ca2e20ffa6 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:12.725659 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-e84bf08f-53bc-4fa7-8254-e3ca2e20ffa6 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1723 microversion: 2.20 time: 0.181065 May 26 18:03:12.733039 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-03c14cf0-82ea-4915-9db6-2ad9df8491b0 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Going to run 1 instances... {{(pid=117723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:03:12.733256 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 117/215] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:03:12 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:03:12.733348 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-03c14cf0-82ea-4915-9db6-2ad9df8491b0 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] [instance: 59e54c78-da19-471d-83cc-494961ae87c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='16351c96-cb02-4711-99d5-fd4d80e8a846',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:03:12.779906 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-03c14cf0-82ea-4915-9db6-2ad9df8491b0 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 16.740510 May 26 18:03:12.780607 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 99/216] 10.222.0.69 () {60 vars in 1146 bytes} [Thu May 26 18:02:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 16742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 18:03:12.790656 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-49bf462d-9060-4446-8a00-b704bd10a39b tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:12.791342 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-49bf462d-9060-4446-8a00-b704bd10a39b tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] [instance: 59e54c78-da19-471d-83cc-494961ae87c8] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:12.845152 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-49bf462d-9060-4446-8a00-b704bd10a39b tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7214f9024ca94bc892857a7296a727df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbc7667eb34449fb8ae5adb5916025d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:12.852117 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-49bf462d-9060-4446-8a00-b704bd10a39b tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] 10.222.0.69 "GET /compute/v2.1/servers/59e54c78-da19-471d-83cc-494961ae87c8" status: 200 len: 1215 microversion: 2.1 time: 0.065521 May 26 18:03:12.853084 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 118/217] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:12 2022] GET /compute/v2.1/servers/59e54c78-da19-471d-83cc-494961ae87c8 => generated 1215 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:13.562771 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-2b54c988-ef50-4854-bcbd-d11239fe4176 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:13.563313 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-2b54c988-ef50-4854-bcbd-d11239fe4176 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:13.569675 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2b54c988-ef50-4854-bcbd-d11239fe4176 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:13.570125 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2b54c988-ef50-4854-bcbd-d11239fe4176 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:13.570881 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2b54c988-ef50-4854-bcbd-d11239fe4176 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:13.571310 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2b54c988-ef50-4854-bcbd-d11239fe4176 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:13.745160 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-2e22acd6-26cb-43ff-9380-99cc80a86bad tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:13.745767 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-2e22acd6-26cb-43ff-9380-99cc80a86bad tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:13.754467 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-2e22acd6-26cb-43ff-9380-99cc80a86bad tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:13.755189 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-2e22acd6-26cb-43ff-9380-99cc80a86bad tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:13.756188 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-2e22acd6-26cb-43ff-9380-99cc80a86bad tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:13.757395 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-2e22acd6-26cb-43ff-9380-99cc80a86bad tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:13.779168 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-2b54c988-ef50-4854-bcbd-d11239fe4176 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:13.787760 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-2b54c988-ef50-4854-bcbd-d11239fe4176 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1522 microversion: 2.1 time: 0.229564 May 26 18:03:13.788391 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 100/218] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:13 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:13.871700 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-613772ef-358a-4b47-ae5a-6e66bdbb6d5d tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:13.873484 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-613772ef-358a-4b47-ae5a-6e66bdbb6d5d tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] [instance: 59e54c78-da19-471d-83cc-494961ae87c8] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:13.880080 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-613772ef-358a-4b47-ae5a-6e66bdbb6d5d tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:13.880541 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-613772ef-358a-4b47-ae5a-6e66bdbb6d5d tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:13.882235 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-613772ef-358a-4b47-ae5a-6e66bdbb6d5d tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:13.882681 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-613772ef-358a-4b47-ae5a-6e66bdbb6d5d tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:13.902028 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-2e22acd6-26cb-43ff-9380-99cc80a86bad tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:13.913540 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-2e22acd6-26cb-43ff-9380-99cc80a86bad tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:13.915431 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-2e22acd6-26cb-43ff-9380-99cc80a86bad tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:13.917483 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-2e22acd6-26cb-43ff-9380-99cc80a86bad tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1723 microversion: 2.20 time: 0.176019 May 26 18:03:13.918478 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 119/219] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:03:13 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:03:13.951714 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-613772ef-358a-4b47-ae5a-6e66bdbb6d5d tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7214f9024ca94bc892857a7296a727df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbc7667eb34449fb8ae5adb5916025d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:13.959374 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-613772ef-358a-4b47-ae5a-6e66bdbb6d5d tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] 10.222.0.69 "GET /compute/v2.1/servers/59e54c78-da19-471d-83cc-494961ae87c8" status: 200 len: 1267 microversion: 2.1 time: 0.092334 May 26 18:03:13.960079 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 101/220] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:13 2022] GET /compute/v2.1/servers/59e54c78-da19-471d-83cc-494961ae87c8 => generated 1267 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:14.805771 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-d0d91991-bba1-43a8-bd30-4eaf8db80161 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:14.806382 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-d0d91991-bba1-43a8-bd30-4eaf8db80161 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:14.813118 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d0d91991-bba1-43a8-bd30-4eaf8db80161 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:14.813580 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d0d91991-bba1-43a8-bd30-4eaf8db80161 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:14.814356 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d0d91991-bba1-43a8-bd30-4eaf8db80161 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:14.814865 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d0d91991-bba1-43a8-bd30-4eaf8db80161 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:14.938451 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-d28d435d-f847-4c07-8e79-146071d170dc tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:14.940802 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-d28d435d-f847-4c07-8e79-146071d170dc tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:14.947678 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d28d435d-f847-4c07-8e79-146071d170dc tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:14.948158 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d28d435d-f847-4c07-8e79-146071d170dc tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:14.948930 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d28d435d-f847-4c07-8e79-146071d170dc tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:14.949529 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d28d435d-f847-4c07-8e79-146071d170dc tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:14.961146 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-d0d91991-bba1-43a8-bd30-4eaf8db80161 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:14.971390 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-d0d91991-bba1-43a8-bd30-4eaf8db80161 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1522 microversion: 2.1 time: 0.169479 May 26 18:03:14.972374 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 120/221] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:14 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:14.977060 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-364c7cb7-80c6-47b8-993b-9d07221d5315 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:14.977797 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-364c7cb7-80c6-47b8-993b-9d07221d5315 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] [instance: 59e54c78-da19-471d-83cc-494961ae87c8] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:14.985135 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-364c7cb7-80c6-47b8-993b-9d07221d5315 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:14.985582 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-364c7cb7-80c6-47b8-993b-9d07221d5315 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:14.986350 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-364c7cb7-80c6-47b8-993b-9d07221d5315 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:14.986942 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-364c7cb7-80c6-47b8-993b-9d07221d5315 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:15.056082 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-364c7cb7-80c6-47b8-993b-9d07221d5315 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7214f9024ca94bc892857a7296a727df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbc7667eb34449fb8ae5adb5916025d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:15.064869 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-364c7cb7-80c6-47b8-993b-9d07221d5315 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] 10.222.0.69 "GET /compute/v2.1/servers/59e54c78-da19-471d-83cc-494961ae87c8" status: 200 len: 1273 microversion: 2.1 time: 0.091348 May 26 18:03:15.068048 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 121/222] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:14 2022] GET /compute/v2.1/servers/59e54c78-da19-471d-83cc-494961ae87c8 => generated 1273 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:15.220667 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-d28d435d-f847-4c07-8e79-146071d170dc tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:15.229178 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-d28d435d-f847-4c07-8e79-146071d170dc tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:15.230955 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-d28d435d-f847-4c07-8e79-146071d170dc tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:15.232817 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-d28d435d-f847-4c07-8e79-146071d170dc tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1723 microversion: 2.20 time: 0.299051 May 26 18:03:15.233388 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 102/223] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:03:14 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1723 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:03:15.988987 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-cde6a5f5-09e6-475e-9bf1-cb73dd3c1a03 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:15.989592 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-cde6a5f5-09e6-475e-9bf1-cb73dd3c1a03 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:15.996072 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-cde6a5f5-09e6-475e-9bf1-cb73dd3c1a03 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:15.996522 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-cde6a5f5-09e6-475e-9bf1-cb73dd3c1a03 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:15.997283 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-cde6a5f5-09e6-475e-9bf1-cb73dd3c1a03 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:15.998254 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-cde6a5f5-09e6-475e-9bf1-cb73dd3c1a03 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:16.083959 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-8c42e2ab-0a3c-47cc-9736-56135e203589 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:16.084792 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-8c42e2ab-0a3c-47cc-9736-56135e203589 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] [instance: 59e54c78-da19-471d-83cc-494961ae87c8] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:16.092503 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8c42e2ab-0a3c-47cc-9736-56135e203589 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:16.093329 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8c42e2ab-0a3c-47cc-9736-56135e203589 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:16.094279 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8c42e2ab-0a3c-47cc-9736-56135e203589 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:16.094838 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8c42e2ab-0a3c-47cc-9736-56135e203589 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:16.136323 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-cde6a5f5-09e6-475e-9bf1-cb73dd3c1a03 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:16.144527 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-cde6a5f5-09e6-475e-9bf1-cb73dd3c1a03 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1522 microversion: 2.1 time: 0.159384 May 26 18:03:16.145114 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 122/224] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:15 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:16.236334 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-8c42e2ab-0a3c-47cc-9736-56135e203589 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7214f9024ca94bc892857a7296a727df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbc7667eb34449fb8ae5adb5916025d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:16.243997 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-8c42e2ab-0a3c-47cc-9736-56135e203589 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] 10.222.0.69 "GET /compute/v2.1/servers/59e54c78-da19-471d-83cc-494961ae87c8" status: 200 len: 1315 microversion: 2.1 time: 0.164950 May 26 18:03:16.244660 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 103/225] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:16 2022] GET /compute/v2.1/servers/59e54c78-da19-471d-83cc-494961ae87c8 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:16.251597 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-c66c2410-86f0-460f-ab2a-83ab78b62f1b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:16.252321 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-c66c2410-86f0-460f-ab2a-83ab78b62f1b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:16.258504 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c66c2410-86f0-460f-ab2a-83ab78b62f1b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:16.258959 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c66c2410-86f0-460f-ab2a-83ab78b62f1b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:16.259731 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c66c2410-86f0-460f-ab2a-83ab78b62f1b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:16.260211 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c66c2410-86f0-460f-ab2a-83ab78b62f1b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:16.390398 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-c66c2410-86f0-460f-ab2a-83ab78b62f1b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:16.398334 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-c66c2410-86f0-460f-ab2a-83ab78b62f1b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:16.399855 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-c66c2410-86f0-460f-ab2a-83ab78b62f1b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:16.401051 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-c66c2410-86f0-460f-ab2a-83ab78b62f1b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1723 microversion: 2.20 time: 0.154164 May 26 18:03:16.401626 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 123/226] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:03:16 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:03:16.477919 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-5c4ebb84-920a-4241-a894-73124c6d206d tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:16.478622 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-5c4ebb84-920a-4241-a894-73124c6d206d tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:16.486926 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5c4ebb84-920a-4241-a894-73124c6d206d tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:16.487546 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5c4ebb84-920a-4241-a894-73124c6d206d tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:16.488621 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5c4ebb84-920a-4241-a894-73124c6d206d tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:16.489146 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5c4ebb84-920a-4241-a894-73124c6d206d tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:16.514588 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-5c4ebb84-920a-4241-a894-73124c6d206d tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20/ips" status: 200 len: 144 microversion: 2.1 time: 0.040605 May 26 18:03:16.515357 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 104/227] 10.222.0.69 () {58 vars in 1247 bytes} [Thu May 26 18:03:16 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20/ips => generated 144 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:03:17.072774 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [req-a51b88fc-cb13-4a52-983f-f5923d3a8291 req-10b9e82a-9649-498d-94d4-a262722d28a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59e54c78-da19-471d-83cc-494961ae87c8", "tag": "f3d1c846-8648-459c-b5ec-62776811dde4"}]} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:03:17.085635 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-a51b88fc-cb13-4a52-983f-f5923d3a8291 req-10b9e82a-9649-498d-94d4-a262722d28a3 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:17.086618 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-a51b88fc-cb13-4a52-983f-f5923d3a8291 req-10b9e82a-9649-498d-94d4-a262722d28a3 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:17.112885 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.compute.server_external_events [req-a51b88fc-cb13-4a52-983f-f5923d3a8291 req-10b9e82a-9649-498d-94d4-a262722d28a3 service nova] Creating event network-changed:f3d1c846-8648-459c-b5ec-62776811dde4 for instance 59e54c78-da19-471d-83cc-494961ae87c8 on hv-cinder-83607 May 26 18:03:17.120574 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [req-a51b88fc-cb13-4a52-983f-f5923d3a8291 req-10b9e82a-9649-498d-94d4-a262722d28a3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051434 May 26 18:03:17.121357 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 124/228] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:03:17.161739 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-dbc3ef5b-7f31-4eb5-9d4c-3356f1567b66 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:17.162356 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-dbc3ef5b-7f31-4eb5-9d4c-3356f1567b66 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:17.171313 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-dbc3ef5b-7f31-4eb5-9d4c-3356f1567b66 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:17.171814 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-dbc3ef5b-7f31-4eb5-9d4c-3356f1567b66 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:17.172831 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-dbc3ef5b-7f31-4eb5-9d4c-3356f1567b66 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:17.173272 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-dbc3ef5b-7f31-4eb5-9d4c-3356f1567b66 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:17.262284 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-59d9b2e0-562c-47d8-89db-814d7c146f7a tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:17.264793 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-59d9b2e0-562c-47d8-89db-814d7c146f7a tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] [instance: 59e54c78-da19-471d-83cc-494961ae87c8] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:17.279480 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-59d9b2e0-562c-47d8-89db-814d7c146f7a tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:17.279829 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-59d9b2e0-562c-47d8-89db-814d7c146f7a tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:17.280645 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-59d9b2e0-562c-47d8-89db-814d7c146f7a tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:17.281078 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-59d9b2e0-562c-47d8-89db-814d7c146f7a tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:17.404404 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-dbc3ef5b-7f31-4eb5-9d4c-3356f1567b66 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:17.412736 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-dbc3ef5b-7f31-4eb5-9d4c-3356f1567b66 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1502 microversion: 2.1 time: 0.255142 May 26 18:03:17.413719 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 105/229] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:17 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1502 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:17.418792 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-1b191129-1dc6-4387-8164-240b78c5918b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:17.419464 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-59d9b2e0-562c-47d8-89db-814d7c146f7a tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7214f9024ca94bc892857a7296a727df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbc7667eb34449fb8ae5adb5916025d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:17.419781 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-1b191129-1dc6-4387-8164-240b78c5918b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:17.428934 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-59d9b2e0-562c-47d8-89db-814d7c146f7a tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] 10.222.0.69 "GET /compute/v2.1/servers/59e54c78-da19-471d-83cc-494961ae87c8" status: 200 len: 1315 microversion: 2.1 time: 0.170825 May 26 18:03:17.429150 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1b191129-1dc6-4387-8164-240b78c5918b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:17.429402 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1b191129-1dc6-4387-8164-240b78c5918b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:17.429692 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 125/230] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:17 2022] GET /compute/v2.1/servers/59e54c78-da19-471d-83cc-494961ae87c8 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:03:17.430572 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1b191129-1dc6-4387-8164-240b78c5918b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:17.431198 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1b191129-1dc6-4387-8164-240b78c5918b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:17.437301 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-0e300075-e013-416d-85fa-aa266afdb10c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:17.440787 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-0e300075-e013-416d-85fa-aa266afdb10c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 3e617476-1bcd-49f6-b16b-1513445fc759] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:17.447175 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0e300075-e013-416d-85fa-aa266afdb10c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:17.447878 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0e300075-e013-416d-85fa-aa266afdb10c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:17.448688 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0e300075-e013-416d-85fa-aa266afdb10c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:17.449128 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0e300075-e013-416d-85fa-aa266afdb10c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:17.584007 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-0e300075-e013-416d-85fa-aa266afdb10c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:17.592238 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-0e300075-e013-416d-85fa-aa266afdb10c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759" status: 200 len: 1515 microversion: 2.1 time: 0.161239 May 26 18:03:17.592837 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 126/231] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:17 2022] GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:17.612548 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-1b191129-1dc6-4387-8164-240b78c5918b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:17.621107 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-1b191129-1dc6-4387-8164-240b78c5918b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:17.623710 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-1b191129-1dc6-4387-8164-240b78c5918b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:17.625025 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-1b191129-1dc6-4387-8164-240b78c5918b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1723 microversion: 2.20 time: 0.210222 May 26 18:03:17.625934 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 106/232] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:03:17 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1723 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:03:18.446770 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-2d9838e4-d29d-4adb-9014-3128422cfb3a tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:18.447307 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-2d9838e4-d29d-4adb-9014-3128422cfb3a tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] [instance: 59e54c78-da19-471d-83cc-494961ae87c8] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:18.454515 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-2d9838e4-d29d-4adb-9014-3128422cfb3a tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:18.454964 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-2d9838e4-d29d-4adb-9014-3128422cfb3a tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:18.455726 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-2d9838e4-d29d-4adb-9014-3128422cfb3a tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:18.456192 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-2d9838e4-d29d-4adb-9014-3128422cfb3a tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:18.586883 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-2d9838e4-d29d-4adb-9014-3128422cfb3a tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7214f9024ca94bc892857a7296a727df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbc7667eb34449fb8ae5adb5916025d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:18.595303 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-2d9838e4-d29d-4adb-9014-3128422cfb3a tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] 10.222.0.69 "GET /compute/v2.1/servers/59e54c78-da19-471d-83cc-494961ae87c8" status: 200 len: 1315 microversion: 2.1 time: 0.152517 May 26 18:03:18.595879 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 127/233] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:18 2022] GET /compute/v2.1/servers/59e54c78-da19-471d-83cc-494961ae87c8 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:18.645219 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-b094106c-8f82-4297-bd91-99912eaffc39 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:18.645826 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-b094106c-8f82-4297-bd91-99912eaffc39 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:18.652145 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b094106c-8f82-4297-bd91-99912eaffc39 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:18.652601 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b094106c-8f82-4297-bd91-99912eaffc39 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:18.653364 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b094106c-8f82-4297-bd91-99912eaffc39 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:18.655077 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b094106c-8f82-4297-bd91-99912eaffc39 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:18.801984 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-b094106c-8f82-4297-bd91-99912eaffc39 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:18.810517 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-b094106c-8f82-4297-bd91-99912eaffc39 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:18.812046 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-b094106c-8f82-4297-bd91-99912eaffc39 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:18.813207 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-b094106c-8f82-4297-bd91-99912eaffc39 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1723 microversion: 2.20 time: 0.172029 May 26 18:03:18.813771 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 107/234] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:03:18 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:03:18.965531 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-e37e59df-9ddd-498a-80dc-b566a7d154e1 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:03:18.966744 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-e37e59df-9ddd-498a-80dc-b566a7d154e1 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 3e617476-1bcd-49f6-b16b-1513445fc759] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:18.973126 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e37e59df-9ddd-498a-80dc-b566a7d154e1 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:18.973577 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e37e59df-9ddd-498a-80dc-b566a7d154e1 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:18.974357 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e37e59df-9ddd-498a-80dc-b566a7d154e1 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:18.974796 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e37e59df-9ddd-498a-80dc-b566a7d154e1 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:18.977468 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:03:19.001550 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.objects.instance [None req-e37e59df-9ddd-498a-80dc-b566a7d154e1 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lazy-loading 'flavor' on Instance uuid 3e617476-1bcd-49f6-b16b-1513445fc759 {{(pid=117722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:03:19.084641 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-e37e59df-9ddd-498a-80dc-b566a7d154e1 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "POST /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759/action" status: 200 len: 32 microversion: 2.1 time: 0.123217 May 26 18:03:19.085585 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 128/235] 10.222.0.69 () {60 vars in 1277 bytes} [Thu May 26 18:03:18 2022] POST /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759/action => generated 32 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 18:03:19.097121 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-6a455807-648d-45fc-bc1b-451a04f7791f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:19.098172 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-6a455807-648d-45fc-bc1b-451a04f7791f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 3e617476-1bcd-49f6-b16b-1513445fc759] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:19.105712 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6a455807-648d-45fc-bc1b-451a04f7791f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:19.106186 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6a455807-648d-45fc-bc1b-451a04f7791f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:19.107143 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6a455807-648d-45fc-bc1b-451a04f7791f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:19.107586 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6a455807-648d-45fc-bc1b-451a04f7791f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:19.254111 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-6a455807-648d-45fc-bc1b-451a04f7791f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:19.266127 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-6a455807-648d-45fc-bc1b-451a04f7791f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759" status: 200 len: 1521 microversion: 2.1 time: 0.174432 May 26 18:03:19.267210 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 108/236] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:19 2022] GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:19.302182 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-f5e30fe3-2742-4b74-a595-8a1207905954 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8f97d962-86f2-46a3-b102-70d8a6712c9d", "device": "/dev/sdb"}} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:03:19.304229 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-f5e30fe3-2742-4b74-a595-8a1207905954 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] [instance: cd2fb019-75ed-45ea-948b-64a627396f02] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:19.311801 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-f5e30fe3-2742-4b74-a595-8a1207905954 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:19.312349 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-f5e30fe3-2742-4b74-a595-8a1207905954 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:19.313183 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-f5e30fe3-2742-4b74-a595-8a1207905954 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:19.313625 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-f5e30fe3-2742-4b74-a595-8a1207905954 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:19.594684 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-f5e30fe3-2742-4b74-a595-8a1207905954 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] 10.222.0.69 "POST /compute/v2.1/servers/cd2fb019-75ed-45ea-948b-64a627396f02/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296732 May 26 18:03:19.599874 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 129/237] 10.222.0.69 () {60 vars in 1322 bytes} [Thu May 26 18:03:19 2022] POST /compute/v2.1/servers/cd2fb019-75ed-45ea-948b-64a627396f02/os-volume_attachments => generated 194 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:03:19.613300 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-5835e5e1-0a14-44a3-8e1f-3399a9b20e97 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:19.614001 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-5835e5e1-0a14-44a3-8e1f-3399a9b20e97 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] [instance: 59e54c78-da19-471d-83cc-494961ae87c8] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:19.621999 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5835e5e1-0a14-44a3-8e1f-3399a9b20e97 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:19.624971 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5835e5e1-0a14-44a3-8e1f-3399a9b20e97 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:19.626102 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5835e5e1-0a14-44a3-8e1f-3399a9b20e97 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:19.626700 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5835e5e1-0a14-44a3-8e1f-3399a9b20e97 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:19.832698 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-6eda5f32-11db-4e58-9cb5-7ca74c596302 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:19.833531 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-6eda5f32-11db-4e58-9cb5-7ca74c596302 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:19.839897 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-6eda5f32-11db-4e58-9cb5-7ca74c596302 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:19.840426 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-6eda5f32-11db-4e58-9cb5-7ca74c596302 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:19.842156 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-6eda5f32-11db-4e58-9cb5-7ca74c596302 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:19.842714 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-6eda5f32-11db-4e58-9cb5-7ca74c596302 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:19.999716 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-6eda5f32-11db-4e58-9cb5-7ca74c596302 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:20.008623 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-6eda5f32-11db-4e58-9cb5-7ca74c596302 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:20.010105 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-6eda5f32-11db-4e58-9cb5-7ca74c596302 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:20.011720 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-6eda5f32-11db-4e58-9cb5-7ca74c596302 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1723 microversion: 2.20 time: 0.184685 May 26 18:03:20.012357 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 130/238] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:03:19 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:03:20.173621 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-5835e5e1-0a14-44a3-8e1f-3399a9b20e97 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7214f9024ca94bc892857a7296a727df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbc7667eb34449fb8ae5adb5916025d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:20.182105 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-5835e5e1-0a14-44a3-8e1f-3399a9b20e97 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] 10.222.0.69 "GET /compute/v2.1/servers/59e54c78-da19-471d-83cc-494961ae87c8" status: 200 len: 1315 microversion: 2.1 time: 0.573000 May 26 18:03:20.183037 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 109/239] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:19 2022] GET /compute/v2.1/servers/59e54c78-da19-471d-83cc-494961ae87c8 => generated 1315 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:20.285387 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-3c2288d9-74ca-4f4f-966f-07894ad261b0 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:20.286204 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-3c2288d9-74ca-4f4f-966f-07894ad261b0 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 3e617476-1bcd-49f6-b16b-1513445fc759] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:20.293633 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3c2288d9-74ca-4f4f-966f-07894ad261b0 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:20.294766 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3c2288d9-74ca-4f4f-966f-07894ad261b0 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:20.295837 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3c2288d9-74ca-4f4f-966f-07894ad261b0 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:20.297228 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3c2288d9-74ca-4f4f-966f-07894ad261b0 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:20.475451 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-3c2288d9-74ca-4f4f-966f-07894ad261b0 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:20.486402 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-3c2288d9-74ca-4f4f-966f-07894ad261b0 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759" status: 200 len: 1521 microversion: 2.1 time: 0.204757 May 26 18:03:20.487072 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 131/240] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:20 2022] GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:21.030119 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-0f581916-d468-4029-b5d8-e1554eefbddf tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:21.030723 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-0f581916-d468-4029-b5d8-e1554eefbddf tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:21.037198 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0f581916-d468-4029-b5d8-e1554eefbddf tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:21.037649 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0f581916-d468-4029-b5d8-e1554eefbddf tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:21.038416 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0f581916-d468-4029-b5d8-e1554eefbddf tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:21.038852 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0f581916-d468-4029-b5d8-e1554eefbddf tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:21.176642 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-0f581916-d468-4029-b5d8-e1554eefbddf tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:21.184589 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-0f581916-d468-4029-b5d8-e1554eefbddf tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:21.186114 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-0f581916-d468-4029-b5d8-e1554eefbddf tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:21.187306 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-0f581916-d468-4029-b5d8-e1554eefbddf tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1723 microversion: 2.20 time: 0.161126 May 26 18:03:21.187870 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 110/241] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:03:21 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:03:21.198544 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-cefbd775-dcb1-4637-a479-4bc8cbdf9ef9 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:21.199152 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-cefbd775-dcb1-4637-a479-4bc8cbdf9ef9 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] [instance: 59e54c78-da19-471d-83cc-494961ae87c8] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:21.208488 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-cefbd775-dcb1-4637-a479-4bc8cbdf9ef9 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:21.208937 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-cefbd775-dcb1-4637-a479-4bc8cbdf9ef9 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:21.209700 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-cefbd775-dcb1-4637-a479-4bc8cbdf9ef9 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:21.210128 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-cefbd775-dcb1-4637-a479-4bc8cbdf9ef9 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:21.354799 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-cefbd775-dcb1-4637-a479-4bc8cbdf9ef9 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7214f9024ca94bc892857a7296a727df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbc7667eb34449fb8ae5adb5916025d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:21.363594 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-cefbd775-dcb1-4637-a479-4bc8cbdf9ef9 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] 10.222.0.69 "GET /compute/v2.1/servers/59e54c78-da19-471d-83cc-494961ae87c8" status: 200 len: 1315 microversion: 2.1 time: 0.168678 May 26 18:03:21.364229 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 132/242] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:21 2022] GET /compute/v2.1/servers/59e54c78-da19-471d-83cc-494961ae87c8 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:21.504565 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-6b3ec965-5bcd-42a6-b7b5-aa597a2a9e58 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:21.505613 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-6b3ec965-5bcd-42a6-b7b5-aa597a2a9e58 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 3e617476-1bcd-49f6-b16b-1513445fc759] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:21.514133 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6b3ec965-5bcd-42a6-b7b5-aa597a2a9e58 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:21.514662 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6b3ec965-5bcd-42a6-b7b5-aa597a2a9e58 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:21.515550 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6b3ec965-5bcd-42a6-b7b5-aa597a2a9e58 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:21.516077 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6b3ec965-5bcd-42a6-b7b5-aa597a2a9e58 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:21.626877 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-73d78bc4-cccc-467b-b239-146e366d3f6b tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "324022c1-7a67-48f2-8a01-1f21139219f8"}} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:03:21.628408 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-73d78bc4-cccc-467b-b239-146e366d3f6b tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:21.635208 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-73d78bc4-cccc-467b-b239-146e366d3f6b tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:21.636050 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-73d78bc4-cccc-467b-b239-146e366d3f6b tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:21.636985 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-73d78bc4-cccc-467b-b239-146e366d3f6b tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:21.637728 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-73d78bc4-cccc-467b-b239-146e366d3f6b tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:21.670414 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-6b3ec965-5bcd-42a6-b7b5-aa597a2a9e58 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:21.678481 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-6b3ec965-5bcd-42a6-b7b5-aa597a2a9e58 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759" status: 200 len: 1521 microversion: 2.1 time: 0.178735 May 26 18:03:21.679405 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 111/243] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:21 2022] GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:21.900539 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-73d78bc4-cccc-467b-b239-146e366d3f6b tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "POST /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279235 May 26 18:03:21.901077 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 133/244] 10.222.0.69 () {60 vars in 1322 bytes} [Thu May 26 18:03:21 2022] POST /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:03:22.205781 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-43f6b9fa-ae4e-4ad9-bfb2-35e2ec4eb9c1 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:22.206394 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-43f6b9fa-ae4e-4ad9-bfb2-35e2ec4eb9c1 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:22.212642 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-43f6b9fa-ae4e-4ad9-bfb2-35e2ec4eb9c1 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:22.213098 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-43f6b9fa-ae4e-4ad9-bfb2-35e2ec4eb9c1 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:22.214435 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-43f6b9fa-ae4e-4ad9-bfb2-35e2ec4eb9c1 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:22.214878 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-43f6b9fa-ae4e-4ad9-bfb2-35e2ec4eb9c1 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:22.348601 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-43f6b9fa-ae4e-4ad9-bfb2-35e2ec4eb9c1 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:22.356797 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-43f6b9fa-ae4e-4ad9-bfb2-35e2ec4eb9c1 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:22.358323 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-43f6b9fa-ae4e-4ad9-bfb2-35e2ec4eb9c1 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:22.359485 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-43f6b9fa-ae4e-4ad9-bfb2-35e2ec4eb9c1 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1723 microversion: 2.20 time: 0.157690 May 26 18:03:22.360105 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 112/245] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:03:22 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:03:22.380928 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-94a3e22a-f814-4852-8301-43a9d71f3e50 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:22.381630 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-94a3e22a-f814-4852-8301-43a9d71f3e50 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] [instance: 59e54c78-da19-471d-83cc-494961ae87c8] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:22.388879 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-94a3e22a-f814-4852-8301-43a9d71f3e50 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:22.389419 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-94a3e22a-f814-4852-8301-43a9d71f3e50 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:22.390189 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-94a3e22a-f814-4852-8301-43a9d71f3e50 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:22.390629 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-94a3e22a-f814-4852-8301-43a9d71f3e50 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:22.521105 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-94a3e22a-f814-4852-8301-43a9d71f3e50 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7214f9024ca94bc892857a7296a727df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbc7667eb34449fb8ae5adb5916025d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:22.541855 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-94a3e22a-f814-4852-8301-43a9d71f3e50 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] 10.222.0.69 "GET /compute/v2.1/servers/59e54c78-da19-471d-83cc-494961ae87c8" status: 200 len: 1315 microversion: 2.1 time: 0.164916 May 26 18:03:22.542610 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 134/246] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:22 2022] GET /compute/v2.1/servers/59e54c78-da19-471d-83cc-494961ae87c8 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:22.696192 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-bce448a7-3f19-44f5-9d0b-1e9f632c5dcd tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:22.696823 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-bce448a7-3f19-44f5-9d0b-1e9f632c5dcd tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 3e617476-1bcd-49f6-b16b-1513445fc759] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:22.698675 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell0:SELECT=2 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:03:22.705604 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-bce448a7-3f19-44f5-9d0b-1e9f632c5dcd tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:22.706087 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-bce448a7-3f19-44f5-9d0b-1e9f632c5dcd tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:22.706898 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-bce448a7-3f19-44f5-9d0b-1e9f632c5dcd tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:22.707338 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-bce448a7-3f19-44f5-9d0b-1e9f632c5dcd tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:22.722837 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell0:SELECT=6 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:03:22.839966 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-bce448a7-3f19-44f5-9d0b-1e9f632c5dcd tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:22.848205 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-bce448a7-3f19-44f5-9d0b-1e9f632c5dcd tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759" status: 200 len: 1521 microversion: 2.1 time: 0.155804 May 26 18:03:22.848785 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 113/247] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:22 2022] GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:23.377821 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-81ebec7f-7568-41d8-a745-ef22a892fd00 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:23.378446 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-81ebec7f-7568-41d8-a745-ef22a892fd00 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:23.380984 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_cell0:SELECT=2 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:03:23.386400 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-81ebec7f-7568-41d8-a745-ef22a892fd00 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:23.386847 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-81ebec7f-7568-41d8-a745-ef22a892fd00 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:23.387602 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-81ebec7f-7568-41d8-a745-ef22a892fd00 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:23.388601 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-81ebec7f-7568-41d8-a745-ef22a892fd00 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:23.518226 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-81ebec7f-7568-41d8-a745-ef22a892fd00 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:23.526101 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-81ebec7f-7568-41d8-a745-ef22a892fd00 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:23.527617 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-81ebec7f-7568-41d8-a745-ef22a892fd00 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:23.529473 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-81ebec7f-7568-41d8-a745-ef22a892fd00 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1723 microversion: 2.20 time: 0.155562 May 26 18:03:23.530037 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 135/248] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:03:23 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:03:23.558807 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-f8f61b28-b8d3-4113-91f8-3117f2ace653 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:23.559659 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-f8f61b28-b8d3-4113-91f8-3117f2ace653 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] [instance: 59e54c78-da19-471d-83cc-494961ae87c8] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:23.566534 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f8f61b28-b8d3-4113-91f8-3117f2ace653 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:23.566991 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f8f61b28-b8d3-4113-91f8-3117f2ace653 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:23.567782 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f8f61b28-b8d3-4113-91f8-3117f2ace653 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:23.568243 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f8f61b28-b8d3-4113-91f8-3117f2ace653 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:23.701867 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-f8f61b28-b8d3-4113-91f8-3117f2ace653 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7214f9024ca94bc892857a7296a727df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbc7667eb34449fb8ae5adb5916025d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:23.709615 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-f8f61b28-b8d3-4113-91f8-3117f2ace653 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] 10.222.0.69 "GET /compute/v2.1/servers/59e54c78-da19-471d-83cc-494961ae87c8" status: 200 len: 1315 microversion: 2.1 time: 0.154744 May 26 18:03:23.710201 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 114/249] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:23 2022] GET /compute/v2.1/servers/59e54c78-da19-471d-83cc-494961ae87c8 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:23.865733 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-bb4db4b3-4922-41a7-b528-bdf2a8bc47f0 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:23.866290 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-bb4db4b3-4922-41a7-b528-bdf2a8bc47f0 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 3e617476-1bcd-49f6-b16b-1513445fc759] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:23.872557 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-bb4db4b3-4922-41a7-b528-bdf2a8bc47f0 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:23.873097 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-bb4db4b3-4922-41a7-b528-bdf2a8bc47f0 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:23.873980 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-bb4db4b3-4922-41a7-b528-bdf2a8bc47f0 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:23.874422 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-bb4db4b3-4922-41a7-b528-bdf2a8bc47f0 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:24.009661 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-bb4db4b3-4922-41a7-b528-bdf2a8bc47f0 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:24.017676 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-bb4db4b3-4922-41a7-b528-bdf2a8bc47f0 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759" status: 200 len: 1521 microversion: 2.1 time: 0.156201 May 26 18:03:24.018273 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 136/250] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:23 2022] GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:24.547459 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-54032651-5d8d-4abd-9811-d7472924823b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:24.548116 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-54032651-5d8d-4abd-9811-d7472924823b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:24.554226 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-54032651-5d8d-4abd-9811-d7472924823b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:24.554674 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-54032651-5d8d-4abd-9811-d7472924823b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:24.555474 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-54032651-5d8d-4abd-9811-d7472924823b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:24.555962 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-54032651-5d8d-4abd-9811-d7472924823b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:24.689634 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-54032651-5d8d-4abd-9811-d7472924823b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:24.697450 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-54032651-5d8d-4abd-9811-d7472924823b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:24.698946 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-54032651-5d8d-4abd-9811-d7472924823b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:24.700671 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-54032651-5d8d-4abd-9811-d7472924823b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1723 microversion: 2.20 time: 0.156707 May 26 18:03:24.701832 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 115/251] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:03:24 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:03:24.726776 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-7e5b8af2-5afb-4dbf-ae1d-4559cbd47a35 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:24.727394 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-7e5b8af2-5afb-4dbf-ae1d-4559cbd47a35 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] [instance: 59e54c78-da19-471d-83cc-494961ae87c8] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:24.733778 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7e5b8af2-5afb-4dbf-ae1d-4559cbd47a35 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:24.734228 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7e5b8af2-5afb-4dbf-ae1d-4559cbd47a35 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:24.735002 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7e5b8af2-5afb-4dbf-ae1d-4559cbd47a35 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:24.735441 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7e5b8af2-5afb-4dbf-ae1d-4559cbd47a35 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:24.867351 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-7e5b8af2-5afb-4dbf-ae1d-4559cbd47a35 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7214f9024ca94bc892857a7296a727df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbc7667eb34449fb8ae5adb5916025d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:24.875638 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-7e5b8af2-5afb-4dbf-ae1d-4559cbd47a35 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] 10.222.0.69 "GET /compute/v2.1/servers/59e54c78-da19-471d-83cc-494961ae87c8" status: 200 len: 1315 microversion: 2.1 time: 0.152709 May 26 18:03:24.876262 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 137/252] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:24 2022] GET /compute/v2.1/servers/59e54c78-da19-471d-83cc-494961ae87c8 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:25.034974 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-0f6cdbef-9e75-4291-8926-5a8eb643dd0b tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:25.035587 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-0f6cdbef-9e75-4291-8926-5a8eb643dd0b tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 3e617476-1bcd-49f6-b16b-1513445fc759] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:25.041683 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0f6cdbef-9e75-4291-8926-5a8eb643dd0b tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:25.042134 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0f6cdbef-9e75-4291-8926-5a8eb643dd0b tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:25.042903 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0f6cdbef-9e75-4291-8926-5a8eb643dd0b tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:25.043341 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0f6cdbef-9e75-4291-8926-5a8eb643dd0b tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:25.062086 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=100 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:03:25.175860 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-0f6cdbef-9e75-4291-8926-5a8eb643dd0b tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:25.183396 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-0f6cdbef-9e75-4291-8926-5a8eb643dd0b tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759" status: 200 len: 1521 microversion: 2.1 time: 0.152207 May 26 18:03:25.183965 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 116/253] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:25 2022] GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:25.702904 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [req-e6e22315-8208-46cc-bbee-2788254dd898 req-a16356c6-4bb4-478d-8a46-913e8c7fede6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59e54c78-da19-471d-83cc-494961ae87c8", "name": "network-vif-plugged", "status": "completed", "tag": "f3d1c846-8648-459c-b5ec-62776811dde4"}]} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:03:25.712514 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-e6e22315-8208-46cc-bbee-2788254dd898 req-a16356c6-4bb4-478d-8a46-913e8c7fede6 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:25.712866 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-e6e22315-8208-46cc-bbee-2788254dd898 req-a16356c6-4bb4-478d-8a46-913e8c7fede6 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:25.722387 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-2f7187f1-0366-4aa8-a42f-5efc7bcf43f5 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:25.723142 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-2f7187f1-0366-4aa8-a42f-5efc7bcf43f5 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:25.729984 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2f7187f1-0366-4aa8-a42f-5efc7bcf43f5 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:25.730681 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2f7187f1-0366-4aa8-a42f-5efc7bcf43f5 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:25.739955 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.compute.server_external_events [req-e6e22315-8208-46cc-bbee-2788254dd898 req-a16356c6-4bb4-478d-8a46-913e8c7fede6 service nova] Creating event network-vif-plugged:f3d1c846-8648-459c-b5ec-62776811dde4 for instance 59e54c78-da19-471d-83cc-494961ae87c8 on hv-cinder-83607 May 26 18:03:25.740773 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2f7187f1-0366-4aa8-a42f-5efc7bcf43f5 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:25.741388 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2f7187f1-0366-4aa8-a42f-5efc7bcf43f5 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:25.746157 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [req-e6e22315-8208-46cc-bbee-2788254dd898 req-a16356c6-4bb4-478d-8a46-913e8c7fede6 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047198 May 26 18:03:25.746771 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 138/254] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:03:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:03:25.876883 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-2f7187f1-0366-4aa8-a42f-5efc7bcf43f5 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:25.884948 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-2f7187f1-0366-4aa8-a42f-5efc7bcf43f5 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:25.886511 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-2f7187f1-0366-4aa8-a42f-5efc7bcf43f5 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:25.888259 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-2f7187f1-0366-4aa8-a42f-5efc7bcf43f5 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1723 microversion: 2.20 time: 0.172556 May 26 18:03:25.888591 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 117/255] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:03:25 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:03:25.892876 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-541eebb8-cf2f-4fca-afa1-af16aac1b759 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:25.893782 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-541eebb8-cf2f-4fca-afa1-af16aac1b759 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] [instance: 59e54c78-da19-471d-83cc-494961ae87c8] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:25.900115 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-541eebb8-cf2f-4fca-afa1-af16aac1b759 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:25.900658 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-541eebb8-cf2f-4fca-afa1-af16aac1b759 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:25.901429 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-541eebb8-cf2f-4fca-afa1-af16aac1b759 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:25.901868 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-541eebb8-cf2f-4fca-afa1-af16aac1b759 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:26.035927 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-541eebb8-cf2f-4fca-afa1-af16aac1b759 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7214f9024ca94bc892857a7296a727df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbc7667eb34449fb8ae5adb5916025d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:26.043603 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-541eebb8-cf2f-4fca-afa1-af16aac1b759 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] 10.222.0.69 "GET /compute/v2.1/servers/59e54c78-da19-471d-83cc-494961ae87c8" status: 200 len: 1315 microversion: 2.1 time: 0.155010 May 26 18:03:26.048054 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 139/256] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:25 2022] GET /compute/v2.1/servers/59e54c78-da19-471d-83cc-494961ae87c8 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:03:26.207983 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-1b3c6275-64f4-48d9-96af-99506e34decb tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:26.209508 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-1b3c6275-64f4-48d9-96af-99506e34decb tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 3e617476-1bcd-49f6-b16b-1513445fc759] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:26.218900 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1b3c6275-64f4-48d9-96af-99506e34decb tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:26.219217 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1b3c6275-64f4-48d9-96af-99506e34decb tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:26.219955 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1b3c6275-64f4-48d9-96af-99506e34decb tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:26.220413 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1b3c6275-64f4-48d9-96af-99506e34decb tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:26.368360 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-1b3c6275-64f4-48d9-96af-99506e34decb tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:26.376408 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-1b3c6275-64f4-48d9-96af-99506e34decb tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759" status: 200 len: 1521 microversion: 2.1 time: 0.178219 May 26 18:03:26.376968 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 118/257] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:26 2022] GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:26.906634 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-f9189db7-734e-434e-a278-451d6a14a475 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:26.907246 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-f9189db7-734e-434e-a278-451d6a14a475 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:26.914200 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-f9189db7-734e-434e-a278-451d6a14a475 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:26.914661 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-f9189db7-734e-434e-a278-451d6a14a475 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:26.915447 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-f9189db7-734e-434e-a278-451d6a14a475 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:26.915896 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-f9189db7-734e-434e-a278-451d6a14a475 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:27.049394 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-f9189db7-734e-434e-a278-451d6a14a475 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:27.051740 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:03:27.061672 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-b04fccb2-a031-4e06-b588-aaa713e1a6f2 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:27.063045 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-f9189db7-734e-434e-a278-451d6a14a475 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:27.064759 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-f9189db7-734e-434e-a278-451d6a14a475 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:27.065131 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-b04fccb2-a031-4e06-b588-aaa713e1a6f2 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] [instance: 59e54c78-da19-471d-83cc-494961ae87c8] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:27.065967 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-f9189db7-734e-434e-a278-451d6a14a475 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1723 microversion: 2.20 time: 0.163299 May 26 18:03:27.076047 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 140/258] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:03:26 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:03:27.081350 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b04fccb2-a031-4e06-b588-aaa713e1a6f2 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:27.082038 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b04fccb2-a031-4e06-b588-aaa713e1a6f2 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:27.083034 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b04fccb2-a031-4e06-b588-aaa713e1a6f2 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:27.083679 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b04fccb2-a031-4e06-b588-aaa713e1a6f2 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:27.224328 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-b04fccb2-a031-4e06-b588-aaa713e1a6f2 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7214f9024ca94bc892857a7296a727df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbc7667eb34449fb8ae5adb5916025d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:27.234491 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-b04fccb2-a031-4e06-b588-aaa713e1a6f2 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] 10.222.0.69 "GET /compute/v2.1/servers/59e54c78-da19-471d-83cc-494961ae87c8" status: 200 len: 1315 microversion: 2.1 time: 0.177620 May 26 18:03:27.235725 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 119/259] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:27 2022] GET /compute/v2.1/servers/59e54c78-da19-471d-83cc-494961ae87c8 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:27.392823 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-9da3b256-62fe-4562-bd7f-095c490bb7e8 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:27.393443 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-9da3b256-62fe-4562-bd7f-095c490bb7e8 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 3e617476-1bcd-49f6-b16b-1513445fc759] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:27.400158 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-9da3b256-62fe-4562-bd7f-095c490bb7e8 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:27.400738 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-9da3b256-62fe-4562-bd7f-095c490bb7e8 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:27.401561 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-9da3b256-62fe-4562-bd7f-095c490bb7e8 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:27.402041 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-9da3b256-62fe-4562-bd7f-095c490bb7e8 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:27.534580 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-9da3b256-62fe-4562-bd7f-095c490bb7e8 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:27.542079 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-9da3b256-62fe-4562-bd7f-095c490bb7e8 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759" status: 200 len: 1521 microversion: 2.1 time: 0.153152 May 26 18:03:27.542657 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 141/260] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:27 2022] GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:28.085143 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-077b1df0-688b-47dc-9e9d-7c623679e964 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:28.085685 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-077b1df0-688b-47dc-9e9d-7c623679e964 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:28.092622 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-077b1df0-688b-47dc-9e9d-7c623679e964 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:28.093129 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-077b1df0-688b-47dc-9e9d-7c623679e964 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:28.093892 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-077b1df0-688b-47dc-9e9d-7c623679e964 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:28.094334 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-077b1df0-688b-47dc-9e9d-7c623679e964 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:28.224355 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-077b1df0-688b-47dc-9e9d-7c623679e964 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:28.232937 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-077b1df0-688b-47dc-9e9d-7c623679e964 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:28.234469 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-077b1df0-688b-47dc-9e9d-7c623679e964 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:28.235643 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-077b1df0-688b-47dc-9e9d-7c623679e964 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1723 microversion: 2.20 time: 0.154580 May 26 18:03:28.236246 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 120/261] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:03:28 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:03:28.251906 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-74324e97-8b30-4932-a387-41243b5fe750 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:28.252546 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-74324e97-8b30-4932-a387-41243b5fe750 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] [instance: 59e54c78-da19-471d-83cc-494961ae87c8] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:28.259300 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-74324e97-8b30-4932-a387-41243b5fe750 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:28.259752 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-74324e97-8b30-4932-a387-41243b5fe750 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:28.260552 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-74324e97-8b30-4932-a387-41243b5fe750 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:28.261013 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-74324e97-8b30-4932-a387-41243b5fe750 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:28.390392 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-74324e97-8b30-4932-a387-41243b5fe750 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7214f9024ca94bc892857a7296a727df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbc7667eb34449fb8ae5adb5916025d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:28.397760 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-74324e97-8b30-4932-a387-41243b5fe750 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] 10.222.0.69 "GET /compute/v2.1/servers/59e54c78-da19-471d-83cc-494961ae87c8" status: 200 len: 1315 microversion: 2.1 time: 0.149837 May 26 18:03:28.398333 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 142/262] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:28 2022] GET /compute/v2.1/servers/59e54c78-da19-471d-83cc-494961ae87c8 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:28.559884 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-a51256b9-9e99-41fc-8de6-212820687a90 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:28.560538 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-a51256b9-9e99-41fc-8de6-212820687a90 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 3e617476-1bcd-49f6-b16b-1513445fc759] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:28.566671 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a51256b9-9e99-41fc-8de6-212820687a90 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:28.567105 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a51256b9-9e99-41fc-8de6-212820687a90 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:28.567881 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a51256b9-9e99-41fc-8de6-212820687a90 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:28.568376 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a51256b9-9e99-41fc-8de6-212820687a90 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:28.700178 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-a51256b9-9e99-41fc-8de6-212820687a90 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:28.708089 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-a51256b9-9e99-41fc-8de6-212820687a90 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759" status: 200 len: 1521 microversion: 2.1 time: 0.153111 May 26 18:03:28.708659 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 121/263] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:28 2022] GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:29.254129 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-3092a852-8e31-4f85-b1a4-30ae16992308 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:29.254779 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-3092a852-8e31-4f85-b1a4-30ae16992308 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:29.261362 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3092a852-8e31-4f85-b1a4-30ae16992308 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:29.261815 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3092a852-8e31-4f85-b1a4-30ae16992308 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:29.262751 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3092a852-8e31-4f85-b1a4-30ae16992308 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:29.263201 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3092a852-8e31-4f85-b1a4-30ae16992308 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:29.391297 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-3092a852-8e31-4f85-b1a4-30ae16992308 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:29.399105 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-3092a852-8e31-4f85-b1a4-30ae16992308 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:29.400638 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-3092a852-8e31-4f85-b1a4-30ae16992308 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:29.401822 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-3092a852-8e31-4f85-b1a4-30ae16992308 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1723 microversion: 2.20 time: 0.151644 May 26 18:03:29.402394 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 143/264] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:03:29 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:03:29.414553 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-958a9012-a224-419d-a64a-625962a1e087 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:29.415164 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-958a9012-a224-419d-a64a-625962a1e087 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] [instance: 59e54c78-da19-471d-83cc-494961ae87c8] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:29.423005 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-958a9012-a224-419d-a64a-625962a1e087 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:29.423421 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-958a9012-a224-419d-a64a-625962a1e087 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:29.424268 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-958a9012-a224-419d-a64a-625962a1e087 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:29.424701 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-958a9012-a224-419d-a64a-625962a1e087 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:29.561663 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-958a9012-a224-419d-a64a-625962a1e087 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7214f9024ca94bc892857a7296a727df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbc7667eb34449fb8ae5adb5916025d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:29.569102 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-958a9012-a224-419d-a64a-625962a1e087 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] 10.222.0.69 "GET /compute/v2.1/servers/59e54c78-da19-471d-83cc-494961ae87c8" status: 200 len: 1315 microversion: 2.1 time: 0.158477 May 26 18:03:29.569666 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 122/265] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:29 2022] GET /compute/v2.1/servers/59e54c78-da19-471d-83cc-494961ae87c8 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:29.724768 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-8bd42779-828d-4cd6-b0ff-0e477e35bee7 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:29.725386 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-8bd42779-828d-4cd6-b0ff-0e477e35bee7 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 3e617476-1bcd-49f6-b16b-1513445fc759] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:29.732409 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-8bd42779-828d-4cd6-b0ff-0e477e35bee7 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:29.732877 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-8bd42779-828d-4cd6-b0ff-0e477e35bee7 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:29.733649 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-8bd42779-828d-4cd6-b0ff-0e477e35bee7 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:29.734090 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-8bd42779-828d-4cd6-b0ff-0e477e35bee7 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:29.866040 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-8bd42779-828d-4cd6-b0ff-0e477e35bee7 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:29.873804 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-8bd42779-828d-4cd6-b0ff-0e477e35bee7 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759" status: 200 len: 1521 microversion: 2.1 time: 0.152810 May 26 18:03:29.874387 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 144/266] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:29 2022] GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:30.420976 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-f1a8cd6d-f5be-4451-a9cd-cb33fe0f6809 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:30.421650 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-f1a8cd6d-f5be-4451-a9cd-cb33fe0f6809 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:30.427987 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f1a8cd6d-f5be-4451-a9cd-cb33fe0f6809 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:30.428465 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f1a8cd6d-f5be-4451-a9cd-cb33fe0f6809 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:30.429236 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f1a8cd6d-f5be-4451-a9cd-cb33fe0f6809 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:30.429679 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f1a8cd6d-f5be-4451-a9cd-cb33fe0f6809 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:30.566366 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-f1a8cd6d-f5be-4451-a9cd-cb33fe0f6809 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:30.574297 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-f1a8cd6d-f5be-4451-a9cd-cb33fe0f6809 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:30.575836 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-f1a8cd6d-f5be-4451-a9cd-cb33fe0f6809 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:30.577757 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-f1a8cd6d-f5be-4451-a9cd-cb33fe0f6809 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1723 microversion: 2.20 time: 0.160174 May 26 18:03:30.578325 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 123/267] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:03:30 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:03:30.586031 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-3bdafe5b-e8d2-4acc-903b-fed59b42d3cb tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:30.586762 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-3bdafe5b-e8d2-4acc-903b-fed59b42d3cb tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] [instance: 59e54c78-da19-471d-83cc-494961ae87c8] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:30.593467 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3bdafe5b-e8d2-4acc-903b-fed59b42d3cb tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:30.593942 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3bdafe5b-e8d2-4acc-903b-fed59b42d3cb tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:30.594690 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3bdafe5b-e8d2-4acc-903b-fed59b42d3cb tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:30.595129 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3bdafe5b-e8d2-4acc-903b-fed59b42d3cb tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:30.722674 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-3bdafe5b-e8d2-4acc-903b-fed59b42d3cb tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7214f9024ca94bc892857a7296a727df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbc7667eb34449fb8ae5adb5916025d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:30.730353 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-3bdafe5b-e8d2-4acc-903b-fed59b42d3cb tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] 10.222.0.69 "GET /compute/v2.1/servers/59e54c78-da19-471d-83cc-494961ae87c8" status: 200 len: 1315 microversion: 2.1 time: 0.147881 May 26 18:03:30.730911 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 145/268] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:30 2022] GET /compute/v2.1/servers/59e54c78-da19-471d-83cc-494961ae87c8 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:30.891339 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-5c9e6364-41bc-4c45-a08c-ec61860053eb tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:30.891942 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-5c9e6364-41bc-4c45-a08c-ec61860053eb tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 3e617476-1bcd-49f6-b16b-1513445fc759] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:30.898071 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5c9e6364-41bc-4c45-a08c-ec61860053eb tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:30.898505 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5c9e6364-41bc-4c45-a08c-ec61860053eb tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:30.899267 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5c9e6364-41bc-4c45-a08c-ec61860053eb tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:30.899702 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5c9e6364-41bc-4c45-a08c-ec61860053eb tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:31.034598 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-5c9e6364-41bc-4c45-a08c-ec61860053eb tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:31.042659 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-5c9e6364-41bc-4c45-a08c-ec61860053eb tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759" status: 200 len: 1521 microversion: 2.1 time: 0.155778 May 26 18:03:31.043256 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 124/269] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:30 2022] GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:31.598894 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-ccce299a-9f15-4d2f-9b97-32d5e9e79e59 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:31.599517 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-ccce299a-9f15-4d2f-9b97-32d5e9e79e59 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:31.606536 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ccce299a-9f15-4d2f-9b97-32d5e9e79e59 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:31.607134 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ccce299a-9f15-4d2f-9b97-32d5e9e79e59 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:31.609009 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ccce299a-9f15-4d2f-9b97-32d5e9e79e59 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:31.609735 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ccce299a-9f15-4d2f-9b97-32d5e9e79e59 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:31.760343 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-6bb6679f-8f40-47d1-be4f-b0026729b7dc tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:31.760829 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-6bb6679f-8f40-47d1-be4f-b0026729b7dc tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] [instance: 59e54c78-da19-471d-83cc-494961ae87c8] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:31.766750 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-ccce299a-9f15-4d2f-9b97-32d5e9e79e59 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:31.774916 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-ccce299a-9f15-4d2f-9b97-32d5e9e79e59 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:31.776759 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-ccce299a-9f15-4d2f-9b97-32d5e9e79e59 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:31.778185 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6bb6679f-8f40-47d1-be4f-b0026729b7dc tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:31.778427 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-ccce299a-9f15-4d2f-9b97-32d5e9e79e59 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1723 microversion: 2.20 time: 0.187049 May 26 18:03:31.778645 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6bb6679f-8f40-47d1-be4f-b0026729b7dc tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:31.779325 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 146/270] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:03:31 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:03:31.779434 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6bb6679f-8f40-47d1-be4f-b0026729b7dc tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:31.779912 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6bb6679f-8f40-47d1-be4f-b0026729b7dc tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:31.929675 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-6bb6679f-8f40-47d1-be4f-b0026729b7dc tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7214f9024ca94bc892857a7296a727df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbc7667eb34449fb8ae5adb5916025d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:31.937608 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-6bb6679f-8f40-47d1-be4f-b0026729b7dc tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] 10.222.0.69 "GET /compute/v2.1/servers/59e54c78-da19-471d-83cc-494961ae87c8" status: 200 len: 1465 microversion: 2.1 time: 0.193474 May 26 18:03:31.938187 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 125/271] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:31 2022] GET /compute/v2.1/servers/59e54c78-da19-471d-83cc-494961ae87c8 => generated 1465 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:03:31.978518 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-68d39bd0-bb78-418b-a01e-4531044d6d35 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:31.979053 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-68d39bd0-bb78-418b-a01e-4531044d6d35 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] [instance: 59e54c78-da19-471d-83cc-494961ae87c8] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:31.985648 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-68d39bd0-bb78-418b-a01e-4531044d6d35 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:31.986100 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-68d39bd0-bb78-418b-a01e-4531044d6d35 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:31.986865 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-68d39bd0-bb78-418b-a01e-4531044d6d35 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:31.987306 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-68d39bd0-bb78-418b-a01e-4531044d6d35 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:32.012000 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-68d39bd0-bb78-418b-a01e-4531044d6d35 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] [instance: 59e54c78-da19-471d-83cc-494961ae87c8] Going to try to terminate instance {{(pid=117722) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:03:32.060477 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-40c9a935-2486-47fb-ba9c-7aae09efa2d2 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:32.062486 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-40c9a935-2486-47fb-ba9c-7aae09efa2d2 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 3e617476-1bcd-49f6-b16b-1513445fc759] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:32.068187 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-40c9a935-2486-47fb-ba9c-7aae09efa2d2 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:32.068719 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-40c9a935-2486-47fb-ba9c-7aae09efa2d2 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:32.069586 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-40c9a935-2486-47fb-ba9c-7aae09efa2d2 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:32.070191 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-40c9a935-2486-47fb-ba9c-7aae09efa2d2 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:32.120855 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-68d39bd0-bb78-418b-a01e-4531044d6d35 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] 10.222.0.69 "DELETE /compute/v2.1/servers/59e54c78-da19-471d-83cc-494961ae87c8" status: 204 len: 0 microversion: 2.1 time: 0.145893 May 26 18:03:32.128173 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 147/272] 10.222.0.69 () {58 vars in 1238 bytes} [Thu May 26 18:03:31 2022] DELETE /compute/v2.1/servers/59e54c78-da19-471d-83cc-494961ae87c8 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 18:03:32.138105 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-d185cabb-5aef-4e53-b2a0-c100e9711ec8 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:32.140807 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-d185cabb-5aef-4e53-b2a0-c100e9711ec8 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] [instance: 59e54c78-da19-471d-83cc-494961ae87c8] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:32.149191 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d185cabb-5aef-4e53-b2a0-c100e9711ec8 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:32.149887 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d185cabb-5aef-4e53-b2a0-c100e9711ec8 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:32.150880 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d185cabb-5aef-4e53-b2a0-c100e9711ec8 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:32.151384 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d185cabb-5aef-4e53-b2a0-c100e9711ec8 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:32.220444 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-40c9a935-2486-47fb-ba9c-7aae09efa2d2 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:32.228313 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-40c9a935-2486-47fb-ba9c-7aae09efa2d2 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759" status: 200 len: 1521 microversion: 2.1 time: 0.171671 May 26 18:03:32.238487 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 126/273] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:32 2022] GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:03:32.293696 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-d185cabb-5aef-4e53-b2a0-c100e9711ec8 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7214f9024ca94bc892857a7296a727df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbc7667eb34449fb8ae5adb5916025d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:32.301384 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-d185cabb-5aef-4e53-b2a0-c100e9711ec8 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] 10.222.0.69 "GET /compute/v2.1/servers/59e54c78-da19-471d-83cc-494961ae87c8" status: 200 len: 1471 microversion: 2.1 time: 0.168221 May 26 18:03:32.301887 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 148/274] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:32 2022] GET /compute/v2.1/servers/59e54c78-da19-471d-83cc-494961ae87c8 => generated 1471 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:03:32.797412 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-43d01fe6-3972-47e1-979b-5944b070eb11 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:32.798024 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-43d01fe6-3972-47e1-979b-5944b070eb11 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:32.805585 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-43d01fe6-3972-47e1-979b-5944b070eb11 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:32.806040 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-43d01fe6-3972-47e1-979b-5944b070eb11 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:32.806824 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-43d01fe6-3972-47e1-979b-5944b070eb11 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:32.807269 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-43d01fe6-3972-47e1-979b-5944b070eb11 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:32.942139 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-43d01fe6-3972-47e1-979b-5944b070eb11 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:32.950070 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-43d01fe6-3972-47e1-979b-5944b070eb11 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:32.951617 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-43d01fe6-3972-47e1-979b-5944b070eb11 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:32.953474 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-43d01fe6-3972-47e1-979b-5944b070eb11 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1723 microversion: 2.20 time: 0.160574 May 26 18:03:32.954042 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 127/275] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:03:32 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:03:33.245861 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-96e5d2de-2ec8-45a5-93c1-bf43965b2bcf tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:33.246471 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-96e5d2de-2ec8-45a5-93c1-bf43965b2bcf tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 3e617476-1bcd-49f6-b16b-1513445fc759] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:33.253123 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-96e5d2de-2ec8-45a5-93c1-bf43965b2bcf tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:33.253576 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-96e5d2de-2ec8-45a5-93c1-bf43965b2bcf tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:33.254348 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-96e5d2de-2ec8-45a5-93c1-bf43965b2bcf tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:33.254793 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-96e5d2de-2ec8-45a5-93c1-bf43965b2bcf tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:33.320320 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-edf5a27b-e5b2-4b0f-b123-50a71ba042fa tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:33.320929 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-edf5a27b-e5b2-4b0f-b123-50a71ba042fa tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] [instance: 59e54c78-da19-471d-83cc-494961ae87c8] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:33.327543 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-edf5a27b-e5b2-4b0f-b123-50a71ba042fa tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:33.328179 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-edf5a27b-e5b2-4b0f-b123-50a71ba042fa tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:33.328956 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-edf5a27b-e5b2-4b0f-b123-50a71ba042fa tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:33.329395 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-edf5a27b-e5b2-4b0f-b123-50a71ba042fa tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:33.384469 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-96e5d2de-2ec8-45a5-93c1-bf43965b2bcf tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:33.393199 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-96e5d2de-2ec8-45a5-93c1-bf43965b2bcf tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759" status: 200 len: 1521 microversion: 2.1 time: 0.151196 May 26 18:03:33.393809 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 149/276] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:33 2022] GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:33.470627 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-edf5a27b-e5b2-4b0f-b123-50a71ba042fa tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7214f9024ca94bc892857a7296a727df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbc7667eb34449fb8ae5adb5916025d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:33.478325 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-edf5a27b-e5b2-4b0f-b123-50a71ba042fa tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] 10.222.0.69 "GET /compute/v2.1/servers/59e54c78-da19-471d-83cc-494961ae87c8" status: 200 len: 1471 microversion: 2.1 time: 0.161794 May 26 18:03:33.478908 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 128/277] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:33 2022] GET /compute/v2.1/servers/59e54c78-da19-471d-83cc-494961ae87c8 => generated 1471 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:03:33.971759 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-06173ada-cf9f-479f-a567-2dd4549b0c66 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:33.972410 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-06173ada-cf9f-479f-a567-2dd4549b0c66 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:33.978533 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-06173ada-cf9f-479f-a567-2dd4549b0c66 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:33.978988 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-06173ada-cf9f-479f-a567-2dd4549b0c66 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:33.980031 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-06173ada-cf9f-479f-a567-2dd4549b0c66 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:33.980480 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-06173ada-cf9f-479f-a567-2dd4549b0c66 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:34.112410 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-06173ada-cf9f-479f-a567-2dd4549b0c66 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:34.120250 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-06173ada-cf9f-479f-a567-2dd4549b0c66 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:34.121766 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-06173ada-cf9f-479f-a567-2dd4549b0c66 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:34.122929 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-06173ada-cf9f-479f-a567-2dd4549b0c66 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1723 microversion: 2.20 time: 0.155172 May 26 18:03:34.124087 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 150/278] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:03:33 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:03:34.410727 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-33f3d495-9f87-4487-8bfd-59586dcce479 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:34.411246 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-33f3d495-9f87-4487-8bfd-59586dcce479 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 3e617476-1bcd-49f6-b16b-1513445fc759] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:34.417273 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-33f3d495-9f87-4487-8bfd-59586dcce479 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:34.417720 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-33f3d495-9f87-4487-8bfd-59586dcce479 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:34.418487 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-33f3d495-9f87-4487-8bfd-59586dcce479 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:34.418922 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-33f3d495-9f87-4487-8bfd-59586dcce479 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:34.495031 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-7feaa990-f2af-451f-9e8a-07a6489f47cb tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:34.495795 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-7feaa990-f2af-451f-9e8a-07a6489f47cb tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] [instance: 59e54c78-da19-471d-83cc-494961ae87c8] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:34.503503 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7feaa990-f2af-451f-9e8a-07a6489f47cb tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:34.504044 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7feaa990-f2af-451f-9e8a-07a6489f47cb tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:34.504904 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7feaa990-f2af-451f-9e8a-07a6489f47cb tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:34.505445 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7feaa990-f2af-451f-9e8a-07a6489f47cb tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:34.551597 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-33f3d495-9f87-4487-8bfd-59586dcce479 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:34.559667 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-33f3d495-9f87-4487-8bfd-59586dcce479 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759" status: 200 len: 1521 microversion: 2.1 time: 0.152894 May 26 18:03:34.560275 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 129/279] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:34 2022] GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:34.637686 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-7feaa990-f2af-451f-9e8a-07a6489f47cb tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7214f9024ca94bc892857a7296a727df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbc7667eb34449fb8ae5adb5916025d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:34.645464 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-7feaa990-f2af-451f-9e8a-07a6489f47cb tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] 10.222.0.69 "GET /compute/v2.1/servers/59e54c78-da19-471d-83cc-494961ae87c8" status: 200 len: 1471 microversion: 2.1 time: 0.154656 May 26 18:03:34.646045 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 151/280] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:34 2022] GET /compute/v2.1/servers/59e54c78-da19-471d-83cc-494961ae87c8 => generated 1471 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:03:35.142352 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-35c9734f-3558-4e5d-aad7-d9eff478e7e8 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:35.142956 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-35c9734f-3558-4e5d-aad7-d9eff478e7e8 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:35.149101 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-35c9734f-3558-4e5d-aad7-d9eff478e7e8 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:35.149545 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-35c9734f-3558-4e5d-aad7-d9eff478e7e8 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:35.150308 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-35c9734f-3558-4e5d-aad7-d9eff478e7e8 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:35.150742 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-35c9734f-3558-4e5d-aad7-d9eff478e7e8 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:35.285912 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-35c9734f-3558-4e5d-aad7-d9eff478e7e8 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:35.294003 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-35c9734f-3558-4e5d-aad7-d9eff478e7e8 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:35.295575 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-35c9734f-3558-4e5d-aad7-d9eff478e7e8 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:35.296779 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-35c9734f-3558-4e5d-aad7-d9eff478e7e8 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1723 microversion: 2.20 time: 0.158972 May 26 18:03:35.297347 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 130/281] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:03:35 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:03:35.577558 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-5088e450-d590-4bdc-a728-877245b742cd tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:35.578393 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-5088e450-d590-4bdc-a728-877245b742cd tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 3e617476-1bcd-49f6-b16b-1513445fc759] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:35.585317 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-5088e450-d590-4bdc-a728-877245b742cd tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:35.585770 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-5088e450-d590-4bdc-a728-877245b742cd tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:35.586544 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-5088e450-d590-4bdc-a728-877245b742cd tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:35.586980 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-5088e450-d590-4bdc-a728-877245b742cd tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:35.662583 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-4d000c54-b8e3-43f1-976f-0cf7b592c256 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:35.663165 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-4d000c54-b8e3-43f1-976f-0cf7b592c256 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] [instance: 59e54c78-da19-471d-83cc-494961ae87c8] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:35.669483 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4d000c54-b8e3-43f1-976f-0cf7b592c256 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:35.672946 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4d000c54-b8e3-43f1-976f-0cf7b592c256 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:35.673778 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4d000c54-b8e3-43f1-976f-0cf7b592c256 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:35.674225 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4d000c54-b8e3-43f1-976f-0cf7b592c256 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:35.754765 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-5088e450-d590-4bdc-a728-877245b742cd tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:35.770953 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-5088e450-d590-4bdc-a728-877245b742cd tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759" status: 200 len: 1521 microversion: 2.1 time: 0.196236 May 26 18:03:35.782109 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 152/282] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:35 2022] GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:35.949261 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-4d000c54-b8e3-43f1-976f-0cf7b592c256 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7214f9024ca94bc892857a7296a727df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbc7667eb34449fb8ae5adb5916025d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:35.959148 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-4d000c54-b8e3-43f1-976f-0cf7b592c256 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] 10.222.0.69 "GET /compute/v2.1/servers/59e54c78-da19-471d-83cc-494961ae87c8" status: 200 len: 1471 microversion: 2.1 time: 0.300298 May 26 18:03:35.959731 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 131/283] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:35 2022] GET /compute/v2.1/servers/59e54c78-da19-471d-83cc-494961ae87c8 => generated 1471 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:03:36.145495 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [req-3fe67ad4-2134-4920-81ea-982b667ad884 req-ea871b2a-ac9e-47b8-8ae9-5eaf4bd0780e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59e54c78-da19-471d-83cc-494961ae87c8", "name": "network-vif-deleted", "tag": "f3d1c846-8648-459c-b5ec-62776811dde4"}]} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:03:36.157983 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-3fe67ad4-2134-4920-81ea-982b667ad884 req-ea871b2a-ac9e-47b8-8ae9-5eaf4bd0780e service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:36.158422 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-3fe67ad4-2134-4920-81ea-982b667ad884 req-ea871b2a-ac9e-47b8-8ae9-5eaf4bd0780e service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:36.176334 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.compute.server_external_events [req-3fe67ad4-2134-4920-81ea-982b667ad884 req-ea871b2a-ac9e-47b8-8ae9-5eaf4bd0780e service nova] Creating event network-vif-deleted:f3d1c846-8648-459c-b5ec-62776811dde4 for instance 59e54c78-da19-471d-83cc-494961ae87c8 on hv-cinder-83607 May 26 18:03:36.181748 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [req-3fe67ad4-2134-4920-81ea-982b667ad884 req-ea871b2a-ac9e-47b8-8ae9-5eaf4bd0780e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039823 May 26 18:03:36.182406 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 153/284] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:03:36.315048 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-bc64b88e-f5bd-4310-93fa-871b4b7bff46 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:36.315681 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-bc64b88e-f5bd-4310-93fa-871b4b7bff46 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:36.317832 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:03:36.323377 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-bc64b88e-f5bd-4310-93fa-871b4b7bff46 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:36.323825 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-bc64b88e-f5bd-4310-93fa-871b4b7bff46 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:36.324645 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-bc64b88e-f5bd-4310-93fa-871b4b7bff46 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:36.325094 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-bc64b88e-f5bd-4310-93fa-871b4b7bff46 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:36.457441 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-bc64b88e-f5bd-4310-93fa-871b4b7bff46 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:36.465405 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-bc64b88e-f5bd-4310-93fa-871b4b7bff46 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:36.466956 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-bc64b88e-f5bd-4310-93fa-871b4b7bff46 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:36.468814 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-bc64b88e-f5bd-4310-93fa-871b4b7bff46 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1723 microversion: 2.20 time: 0.157973 May 26 18:03:36.469387 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 132/285] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:03:36 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:03:36.790240 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-ebf44eba-3484-407b-8b96-7b8df835b7cc tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:36.790936 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-ebf44eba-3484-407b-8b96-7b8df835b7cc tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 3e617476-1bcd-49f6-b16b-1513445fc759] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:36.797700 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ebf44eba-3484-407b-8b96-7b8df835b7cc tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:36.798150 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ebf44eba-3484-407b-8b96-7b8df835b7cc tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:36.798940 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ebf44eba-3484-407b-8b96-7b8df835b7cc tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:36.799382 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ebf44eba-3484-407b-8b96-7b8df835b7cc tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:36.938169 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-ebf44eba-3484-407b-8b96-7b8df835b7cc tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:36.946277 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-ebf44eba-3484-407b-8b96-7b8df835b7cc tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759" status: 200 len: 1521 microversion: 2.1 time: 0.160115 May 26 18:03:36.946856 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 154/286] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:36 2022] GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:36.976460 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-6159faad-771a-4526-8c56-a9999f177c46 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:36.977056 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-6159faad-771a-4526-8c56-a9999f177c46 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] [instance: 59e54c78-da19-471d-83cc-494961ae87c8] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:36.984320 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6159faad-771a-4526-8c56-a9999f177c46 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:36.984767 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6159faad-771a-4526-8c56-a9999f177c46 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:36.985525 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6159faad-771a-4526-8c56-a9999f177c46 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:36.985952 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6159faad-771a-4526-8c56-a9999f177c46 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:36.990060 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=100 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:03:37.017846 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6159faad-771a-4526-8c56-a9999f177c46 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:37.018196 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6159faad-771a-4526-8c56-a9999f177c46 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:37.018635 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.objects.instance [None req-6159faad-771a-4526-8c56-a9999f177c46 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lazy-loading 'fault' on Instance uuid 59e54c78-da19-471d-83cc-494961ae87c8 {{(pid=117723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:03:37.063210 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-6159faad-771a-4526-8c56-a9999f177c46 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7214f9024ca94bc892857a7296a727df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbc7667eb34449fb8ae5adb5916025d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:37.070746 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-6159faad-771a-4526-8c56-a9999f177c46 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] 10.222.0.69 "GET /compute/v2.1/servers/59e54c78-da19-471d-83cc-494961ae87c8" status: 200 len: 1305 microversion: 2.1 time: 0.098193 May 26 18:03:37.071310 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 133/287] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:36 2022] GET /compute/v2.1/servers/59e54c78-da19-471d-83cc-494961ae87c8 => generated 1305 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:37.487429 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-707b5a39-9edf-4411-93ab-3d043b40bb15 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:37.488070 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-707b5a39-9edf-4411-93ab-3d043b40bb15 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:37.494155 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-707b5a39-9edf-4411-93ab-3d043b40bb15 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:37.494611 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-707b5a39-9edf-4411-93ab-3d043b40bb15 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:37.495377 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-707b5a39-9edf-4411-93ab-3d043b40bb15 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:37.495820 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-707b5a39-9edf-4411-93ab-3d043b40bb15 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:37.629928 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-707b5a39-9edf-4411-93ab-3d043b40bb15 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:37.638020 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-707b5a39-9edf-4411-93ab-3d043b40bb15 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:37.639625 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-707b5a39-9edf-4411-93ab-3d043b40bb15 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:37.640832 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-707b5a39-9edf-4411-93ab-3d043b40bb15 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1723 microversion: 2.20 time: 0.157963 May 26 18:03:37.641449 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 155/288] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:03:37 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:03:37.965049 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-30d1b925-79ae-4177-b668-89b9d170d138 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:37.965667 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-30d1b925-79ae-4177-b668-89b9d170d138 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 3e617476-1bcd-49f6-b16b-1513445fc759] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:37.972854 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-30d1b925-79ae-4177-b668-89b9d170d138 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:37.973304 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-30d1b925-79ae-4177-b668-89b9d170d138 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:37.974100 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-30d1b925-79ae-4177-b668-89b9d170d138 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:37.974506 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-30d1b925-79ae-4177-b668-89b9d170d138 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:38.087820 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-7ec48412-072a-4574-826b-c6f526e1ca07 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:38.088503 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-7ec48412-072a-4574-826b-c6f526e1ca07 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] [instance: 59e54c78-da19-471d-83cc-494961ae87c8] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:38.095211 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7ec48412-072a-4574-826b-c6f526e1ca07 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:38.095664 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7ec48412-072a-4574-826b-c6f526e1ca07 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:38.096512 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7ec48412-072a-4574-826b-c6f526e1ca07 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:38.096945 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7ec48412-072a-4574-826b-c6f526e1ca07 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:38.110342 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-30d1b925-79ae-4177-b668-89b9d170d138 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:38.113475 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:03:38.118159 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-30d1b925-79ae-4177-b668-89b9d170d138 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759" status: 200 len: 1521 microversion: 2.1 time: 0.156893 May 26 18:03:38.118832 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 134/289] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:37 2022] GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:38.132759 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7ec48412-072a-4574-826b-c6f526e1ca07 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:38.133204 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7ec48412-072a-4574-826b-c6f526e1ca07 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:38.133654 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.objects.instance [None req-7ec48412-072a-4574-826b-c6f526e1ca07 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lazy-loading 'fault' on Instance uuid 59e54c78-da19-471d-83cc-494961ae87c8 {{(pid=117722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:03:38.178188 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-7ec48412-072a-4574-826b-c6f526e1ca07 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7214f9024ca94bc892857a7296a727df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbc7667eb34449fb8ae5adb5916025d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:38.186105 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-7ec48412-072a-4574-826b-c6f526e1ca07 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] 10.222.0.69 "GET /compute/v2.1/servers/59e54c78-da19-471d-83cc-494961ae87c8" status: 200 len: 1305 microversion: 2.1 time: 0.101592 May 26 18:03:38.186759 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 156/290] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:38 2022] GET /compute/v2.1/servers/59e54c78-da19-471d-83cc-494961ae87c8 => generated 1305 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:03:38.659572 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-620ef583-2e22-46ed-bd0a-788436860f10 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:38.660208 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-620ef583-2e22-46ed-bd0a-788436860f10 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:38.666481 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-620ef583-2e22-46ed-bd0a-788436860f10 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:38.666933 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-620ef583-2e22-46ed-bd0a-788436860f10 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:38.667696 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-620ef583-2e22-46ed-bd0a-788436860f10 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:38.668169 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-620ef583-2e22-46ed-bd0a-788436860f10 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:38.800536 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-620ef583-2e22-46ed-bd0a-788436860f10 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:38.808543 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-620ef583-2e22-46ed-bd0a-788436860f10 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:38.810079 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-620ef583-2e22-46ed-bd0a-788436860f10 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:38.811339 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-620ef583-2e22-46ed-bd0a-788436860f10 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1723 microversion: 2.20 time: 0.155745 May 26 18:03:38.811900 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 135/291] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:03:38 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:03:39.136677 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-09f3762e-0f48-49b3-a268-bf11fccaf9fd tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:39.137291 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-09f3762e-0f48-49b3-a268-bf11fccaf9fd tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 3e617476-1bcd-49f6-b16b-1513445fc759] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:39.144563 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-09f3762e-0f48-49b3-a268-bf11fccaf9fd tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:39.145017 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-09f3762e-0f48-49b3-a268-bf11fccaf9fd tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:39.145795 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-09f3762e-0f48-49b3-a268-bf11fccaf9fd tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:39.146235 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-09f3762e-0f48-49b3-a268-bf11fccaf9fd tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:39.203805 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-3ce524bb-dcac-440c-b422-947285afde78 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:39.204386 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-3ce524bb-dcac-440c-b422-947285afde78 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] [instance: 59e54c78-da19-471d-83cc-494961ae87c8] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:39.210422 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3ce524bb-dcac-440c-b422-947285afde78 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:39.210870 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3ce524bb-dcac-440c-b422-947285afde78 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:39.211638 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3ce524bb-dcac-440c-b422-947285afde78 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:39.212100 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3ce524bb-dcac-440c-b422-947285afde78 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:39.244620 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3ce524bb-dcac-440c-b422-947285afde78 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:39.245074 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3ce524bb-dcac-440c-b422-947285afde78 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:39.245528 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.objects.instance [None req-3ce524bb-dcac-440c-b422-947285afde78 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lazy-loading 'fault' on Instance uuid 59e54c78-da19-471d-83cc-494961ae87c8 {{(pid=117723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:03:39.289044 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-09f3762e-0f48-49b3-a268-bf11fccaf9fd tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:39.301631 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-3ce524bb-dcac-440c-b422-947285afde78 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7214f9024ca94bc892857a7296a727df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbc7667eb34449fb8ae5adb5916025d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:39.305073 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-09f3762e-0f48-49b3-a268-bf11fccaf9fd tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759" status: 200 len: 1521 microversion: 2.1 time: 0.172401 May 26 18:03:39.305666 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 157/292] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:39 2022] GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:39.309590 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-3ce524bb-dcac-440c-b422-947285afde78 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] 10.222.0.69 "GET /compute/v2.1/servers/59e54c78-da19-471d-83cc-494961ae87c8" status: 200 len: 1305 microversion: 2.1 time: 0.110725 May 26 18:03:39.310255 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 136/293] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:39 2022] GET /compute/v2.1/servers/59e54c78-da19-471d-83cc-494961ae87c8 => generated 1305 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:03:39.830444 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-45896af0-6fb9-47d7-932e-ea39f6737337 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:39.830963 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-45896af0-6fb9-47d7-932e-ea39f6737337 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:39.837370 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-45896af0-6fb9-47d7-932e-ea39f6737337 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:39.837827 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-45896af0-6fb9-47d7-932e-ea39f6737337 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:39.838607 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-45896af0-6fb9-47d7-932e-ea39f6737337 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:39.839051 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-45896af0-6fb9-47d7-932e-ea39f6737337 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:39.973546 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-45896af0-6fb9-47d7-932e-ea39f6737337 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:39.981703 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-45896af0-6fb9-47d7-932e-ea39f6737337 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:39.983276 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-45896af0-6fb9-47d7-932e-ea39f6737337 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:39.984476 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-45896af0-6fb9-47d7-932e-ea39f6737337 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1723 microversion: 2.20 time: 0.158848 May 26 18:03:39.985041 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 158/294] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:03:39 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:03:40.323070 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-ef67d630-4fd0-4f49-936a-11b88af11d87 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:40.323682 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-ef67d630-4fd0-4f49-936a-11b88af11d87 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 3e617476-1bcd-49f6-b16b-1513445fc759] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:40.327152 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-11d26b29-7327-42f8-a320-890da0c15275 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:40.327775 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-11d26b29-7327-42f8-a320-890da0c15275 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] [instance: 59e54c78-da19-471d-83cc-494961ae87c8] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:40.330678 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ef67d630-4fd0-4f49-936a-11b88af11d87 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:40.331136 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ef67d630-4fd0-4f49-936a-11b88af11d87 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:40.331982 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ef67d630-4fd0-4f49-936a-11b88af11d87 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:40.332389 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ef67d630-4fd0-4f49-936a-11b88af11d87 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:40.334603 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-11d26b29-7327-42f8-a320-890da0c15275 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:40.335050 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-11d26b29-7327-42f8-a320-890da0c15275 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:40.335817 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-11d26b29-7327-42f8-a320-890da0c15275 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:40.336280 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-11d26b29-7327-42f8-a320-890da0c15275 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:40.350261 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.wsgi [None req-11d26b29-7327-42f8-a320-890da0c15275 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] HTTP exception thrown: Instance 59e54c78-da19-471d-83cc-494961ae87c8 could not be found. May 26 18:03:40.351962 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-11d26b29-7327-42f8-a320-890da0c15275 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Request method failure captured: May 26 18:03:40.351962 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: request: GET /compute/v2.1/servers/59e54c78-da19-471d-83cc-494961ae87c8 HTTP/1.1 May 26 18:03:40.351962 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Accept: application/json May 26 18:03:40.351962 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Accept-Encoding: identity May 26 18:03:40.351962 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Connection: close May 26 18:03:40.351962 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Content-Length: 0 May 26 18:03:40.351962 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Content-Type: application/json May 26 18:03:40.351962 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Host: 10.222.0.69 May 26 18:03:40.351962 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Openstack-System-Scope: None May 26 18:03:40.351962 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: User-Agent: python-urllib3/1.26.9 May 26 18:03:40.351962 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Auth-Token: gAAAAABij8DOAh3ecGRLollvL_gUyibcwWjR7wHQuYUFNx6PYezVBY7OiJKO0XCd8eWw4mkBzaSL1mQz-DoSdj6gufAEzZI0J2q793ucbl0ldWC40Ym7KU3UkCLmbip55Fw-NzdLUcM7z-kCXrjq0rhPxBlZDq7XXoIRNCUkqzA3QPJKjwKZx3Y May 26 18:03:40.351962 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Domain-Id: None May 26 18:03:40.351962 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Domain-Name: None May 26 18:03:40.351962 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Identity-Status: Confirmed May 26 18:03:40.351962 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Is-Admin-Project: True May 26 18:03:40.351962 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Domain-Id: default May 26 18:03:40.351962 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Domain-Name: Default May 26 18:03:40.351962 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Id: fbbc7667eb34449fb8ae5adb5916025d May 26 18:03:40.351962 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Name: tempest-VolumesNegativeTest-399922149 May 26 18:03:40.351962 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Role: member,reader May 26 18:03:40.351962 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Roles: member,reader May 26 18:03:40.353473 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fbbc7667eb34449fb8ae5adb5916025d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/fbbc7667eb34449fb8ae5adb5916025d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fbbc7667eb34449fb8ae5adb5916025d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_fbbc7667eb34449fb8ae5adb5916025d"}]}] May 26 18:03:40.353473 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant: tempest-VolumesNegativeTest-399922149 May 26 18:03:40.353473 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant-Id: fbbc7667eb34449fb8ae5adb5916025d May 26 18:03:40.353473 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant-Name: tempest-VolumesNegativeTest-399922149 May 26 18:03:40.353473 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User: tempest-VolumesNegativeTest-399922149-project May 26 18:03:40.353473 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Domain-Id: default May 26 18:03:40.353473 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Domain-Name: Default May 26 18:03:40.353473 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Id: 7214f9024ca94bc892857a7296a727df May 26 18:03:40.353473 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Name: tempest-VolumesNegativeTest-399922149-project May 26 18:03:40.353473 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: method: > May 26 18:03:40.353473 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: exception: Instance 59e54c78-da19-471d-83cc-494961ae87c8 could not be found. May 26 18:03:40.353473 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: action_args: {'id': '59e54c78-da19-471d-83cc-494961ae87c8'} May 26 18:03:40.354193 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:03:40.354193 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:03:40.354193 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:03:40.354193 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:03:40.354193 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:03:40.354193 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:03:40.354193 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:03:40.354193 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:03:40.354193 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:03:40.354193 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:03:40.354193 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59e54c78-da19-471d-83cc-494961ae87c8 could not be found. May 26 18:03:40.354193 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:03:40.354193 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:03:40.354193 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:03:40.354193 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:03:40.354193 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:03:40.354193 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:03:40.354193 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:03:40.354193 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:03:40.354193 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:03:40.355556 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:03:40.355556 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:03:40.355556 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:03:40.355556 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:03:40.355556 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:03:40.355556 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:03:40.355556 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:03:40.355556 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59e54c78-da19-471d-83cc-494961ae87c8 could not be found. May 26 18:03:40.355556 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:03:40.355556 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:03:40.355556 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:03:40.355556 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:03:40.355556 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:03:40.355556 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:03:40.355556 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:03:40.355556 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:03:40.355556 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59e54c78-da19-471d-83cc-494961ae87c8 could not be found. May 26 18:03:40.355556 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:03:40.356571 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-11d26b29-7327-42f8-a320-890da0c15275 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] Returning 404 to user: Instance 59e54c78-da19-471d-83cc-494961ae87c8 could not be found. {{(pid=117722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:03:40.356571 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-11d26b29-7327-42f8-a320-890da0c15275 tempest-VolumesNegativeTest-399922149 tempest-VolumesNegativeTest-399922149-project] 10.222.0.69 "GET /compute/v2.1/servers/59e54c78-da19-471d-83cc-494961ae87c8" status: 404 len: 111 microversion: 2.1 time: 0.030788 May 26 18:03:40.356571 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 159/295] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:40 2022] GET /compute/v2.1/servers/59e54c78-da19-471d-83cc-494961ae87c8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 18:03:40.476537 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-ef67d630-4fd0-4f49-936a-11b88af11d87 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:40.485239 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-ef67d630-4fd0-4f49-936a-11b88af11d87 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759" status: 200 len: 1521 microversion: 2.1 time: 0.166041 May 26 18:03:40.485828 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 137/296] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:40 2022] GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:41.003747 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-eff0487d-1409-4e66-93ab-d058b65220fe tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:41.004426 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-eff0487d-1409-4e66-93ab-d058b65220fe tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:41.010642 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-eff0487d-1409-4e66-93ab-d058b65220fe tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:41.011101 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-eff0487d-1409-4e66-93ab-d058b65220fe tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:41.011887 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-eff0487d-1409-4e66-93ab-d058b65220fe tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:41.012342 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-eff0487d-1409-4e66-93ab-d058b65220fe tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:41.170927 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-eff0487d-1409-4e66-93ab-d058b65220fe tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:41.179230 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-eff0487d-1409-4e66-93ab-d058b65220fe tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:41.180801 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-eff0487d-1409-4e66-93ab-d058b65220fe tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:41.181978 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-eff0487d-1409-4e66-93ab-d058b65220fe tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1723 microversion: 2.20 time: 0.182623 May 26 18:03:41.182586 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 160/297] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:03:40 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:03:41.503026 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-249f6ae4-0df7-4a17-b6e1-b520fae06913 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:41.504358 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-249f6ae4-0df7-4a17-b6e1-b520fae06913 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 3e617476-1bcd-49f6-b16b-1513445fc759] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:41.510610 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-249f6ae4-0df7-4a17-b6e1-b520fae06913 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:41.511056 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-249f6ae4-0df7-4a17-b6e1-b520fae06913 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:41.511831 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-249f6ae4-0df7-4a17-b6e1-b520fae06913 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:41.512307 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-249f6ae4-0df7-4a17-b6e1-b520fae06913 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:41.649529 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-249f6ae4-0df7-4a17-b6e1-b520fae06913 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:41.658755 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-249f6ae4-0df7-4a17-b6e1-b520fae06913 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759" status: 200 len: 1521 microversion: 2.1 time: 0.160360 May 26 18:03:41.659406 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 138/298] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:41 2022] GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:42.206026 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-871988b0-3b32-4bf2-94cd-8eede6d3587d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:42.206026 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-871988b0-3b32-4bf2-94cd-8eede6d3587d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:42.209068 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:03:42.210822 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-871988b0-3b32-4bf2-94cd-8eede6d3587d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:42.211283 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-871988b0-3b32-4bf2-94cd-8eede6d3587d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:42.212277 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-871988b0-3b32-4bf2-94cd-8eede6d3587d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:42.212712 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-871988b0-3b32-4bf2-94cd-8eede6d3587d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:42.353927 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-871988b0-3b32-4bf2-94cd-8eede6d3587d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:42.363039 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-871988b0-3b32-4bf2-94cd-8eede6d3587d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:42.364618 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-871988b0-3b32-4bf2-94cd-8eede6d3587d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:42.366207 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-871988b0-3b32-4bf2-94cd-8eede6d3587d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1723 microversion: 2.20 time: 0.169065 May 26 18:03:42.366767 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 161/299] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:03:42 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:03:42.674693 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-35a53708-2103-46bf-bcbc-ddca0c69d63c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:42.675346 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-35a53708-2103-46bf-bcbc-ddca0c69d63c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 3e617476-1bcd-49f6-b16b-1513445fc759] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:42.681533 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-35a53708-2103-46bf-bcbc-ddca0c69d63c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:42.682003 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-35a53708-2103-46bf-bcbc-ddca0c69d63c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:42.682792 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-35a53708-2103-46bf-bcbc-ddca0c69d63c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:42.683223 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-35a53708-2103-46bf-bcbc-ddca0c69d63c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:42.838671 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-35a53708-2103-46bf-bcbc-ddca0c69d63c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:42.847448 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-35a53708-2103-46bf-bcbc-ddca0c69d63c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759" status: 200 len: 1521 microversion: 2.1 time: 0.176760 May 26 18:03:42.848049 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 139/300] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:42 2022] GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:43.384601 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-df942364-aa13-4b39-b9da-e8088b67e32e tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:43.385253 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-df942364-aa13-4b39-b9da-e8088b67e32e tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:43.392700 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-df942364-aa13-4b39-b9da-e8088b67e32e tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:43.393147 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-df942364-aa13-4b39-b9da-e8088b67e32e tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:43.393919 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-df942364-aa13-4b39-b9da-e8088b67e32e tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:43.394355 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-df942364-aa13-4b39-b9da-e8088b67e32e tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:43.529898 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-df942364-aa13-4b39-b9da-e8088b67e32e tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:43.537856 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-df942364-aa13-4b39-b9da-e8088b67e32e tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:43.539367 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-df942364-aa13-4b39-b9da-e8088b67e32e tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:43.540575 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-df942364-aa13-4b39-b9da-e8088b67e32e tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1723 microversion: 2.20 time: 0.159925 May 26 18:03:43.541178 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 162/301] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:03:43 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:03:43.864823 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-9800b114-7e15-4738-a850-1b6a76701812 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:43.865417 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-9800b114-7e15-4738-a850-1b6a76701812 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 3e617476-1bcd-49f6-b16b-1513445fc759] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:43.871786 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9800b114-7e15-4738-a850-1b6a76701812 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:43.872393 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9800b114-7e15-4738-a850-1b6a76701812 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:43.873253 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9800b114-7e15-4738-a850-1b6a76701812 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:43.873725 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9800b114-7e15-4738-a850-1b6a76701812 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:44.008816 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-9800b114-7e15-4738-a850-1b6a76701812 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:44.016792 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-9800b114-7e15-4738-a850-1b6a76701812 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759" status: 200 len: 1521 microversion: 2.1 time: 0.155929 May 26 18:03:44.017367 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 140/302] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:43 2022] GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:44.349433 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-4b2b64a1-6d3a-44fb-b230-692c8d6dc905 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:03:44.356940 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-4b2b64a1-6d3a-44fb-b230-692c8d6dc905 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:44.357431 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-4b2b64a1-6d3a-44fb-b230-692c8d6dc905 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:44.425574 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-4b2b64a1-6d3a-44fb-b230-692c8d6dc905 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Going to try to stop instance {{(pid=117722) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 26 18:03:44.486577 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-4b2b64a1-6d3a-44fb-b230-692c8d6dc905 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "POST /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20/action" status: 202 len: 0 microversion: 2.1 time: 0.141130 May 26 18:03:44.487744 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 163/303] 10.222.0.69 () {60 vars in 1277 bytes} [Thu May 26 18:03:44 2022] POST /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:03:44.498719 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-566d2b50-6227-41c4-9e84-d2a9297331f6 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:44.499355 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-566d2b50-6227-41c4-9e84-d2a9297331f6 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:44.511368 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-566d2b50-6227-41c4-9e84-d2a9297331f6 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:44.511819 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-566d2b50-6227-41c4-9e84-d2a9297331f6 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:44.512659 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-566d2b50-6227-41c4-9e84-d2a9297331f6 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:44.513121 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-566d2b50-6227-41c4-9e84-d2a9297331f6 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:44.562134 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-3cfe9b72-0063-4e99-abd1-c9e5903ab25c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:44.563020 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-3cfe9b72-0063-4e99-abd1-c9e5903ab25c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:44.570036 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3cfe9b72-0063-4e99-abd1-c9e5903ab25c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:44.570776 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3cfe9b72-0063-4e99-abd1-c9e5903ab25c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:44.571861 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3cfe9b72-0063-4e99-abd1-c9e5903ab25c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:44.572469 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3cfe9b72-0063-4e99-abd1-c9e5903ab25c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:44.704374 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-566d2b50-6227-41c4-9e84-d2a9297331f6 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:44.715034 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-566d2b50-6227-41c4-9e84-d2a9297331f6 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1721 microversion: 2.1 time: 0.221325 May 26 18:03:44.736748 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 141/304] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:44 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1721 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:44.775915 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-3cfe9b72-0063-4e99-abd1-c9e5903ab25c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:44.785420 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-3cfe9b72-0063-4e99-abd1-c9e5903ab25c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:44.787049 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-3cfe9b72-0063-4e99-abd1-c9e5903ab25c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:44.788357 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-3cfe9b72-0063-4e99-abd1-c9e5903ab25c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1723 microversion: 2.20 time: 0.233324 May 26 18:03:44.789009 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 164/305] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:03:44 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1723 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:03:45.034290 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-a6fe2e83-bddb-48db-af92-c07de9149d00 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:45.034880 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-a6fe2e83-bddb-48db-af92-c07de9149d00 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 3e617476-1bcd-49f6-b16b-1513445fc759] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:45.041047 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a6fe2e83-bddb-48db-af92-c07de9149d00 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:45.041499 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a6fe2e83-bddb-48db-af92-c07de9149d00 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:45.042268 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a6fe2e83-bddb-48db-af92-c07de9149d00 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:45.042705 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a6fe2e83-bddb-48db-af92-c07de9149d00 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:45.201309 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-a6fe2e83-bddb-48db-af92-c07de9149d00 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:45.209369 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-a6fe2e83-bddb-48db-af92-c07de9149d00 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759" status: 200 len: 1521 microversion: 2.1 time: 0.179622 May 26 18:03:45.210081 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 142/306] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:45 2022] GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:45.734673 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-39a4affd-8744-4897-a680-aab8c26a0cb1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:45.735998 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-39a4affd-8744-4897-a680-aab8c26a0cb1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:45.745037 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-39a4affd-8744-4897-a680-aab8c26a0cb1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:45.745037 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-39a4affd-8744-4897-a680-aab8c26a0cb1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:45.746052 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-39a4affd-8744-4897-a680-aab8c26a0cb1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:45.746726 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-39a4affd-8744-4897-a680-aab8c26a0cb1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:45.810386 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-1e11efe3-0364-4e48-90c7-ef64b3f17bec tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:45.811494 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-1e11efe3-0364-4e48-90c7-ef64b3f17bec tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:45.819025 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1e11efe3-0364-4e48-90c7-ef64b3f17bec tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:45.819795 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1e11efe3-0364-4e48-90c7-ef64b3f17bec tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:45.821173 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1e11efe3-0364-4e48-90c7-ef64b3f17bec tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:45.821701 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1e11efe3-0364-4e48-90c7-ef64b3f17bec tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:45.948614 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-39a4affd-8744-4897-a680-aab8c26a0cb1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:45.959608 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-39a4affd-8744-4897-a680-aab8c26a0cb1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1721 microversion: 2.1 time: 0.230842 May 26 18:03:45.960680 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 165/307] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:45 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1721 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:46.000381 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-1e11efe3-0364-4e48-90c7-ef64b3f17bec tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:46.009207 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-1e11efe3-0364-4e48-90c7-ef64b3f17bec tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:46.010735 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-1e11efe3-0364-4e48-90c7-ef64b3f17bec tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:46.011931 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-1e11efe3-0364-4e48-90c7-ef64b3f17bec tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1744 microversion: 2.20 time: 0.208862 May 26 18:03:46.012542 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 143/308] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:03:45 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1744 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:03:46.228365 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-e6722035-601f-4ca9-869d-d560ba88060c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:46.228665 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-e6722035-601f-4ca9-869d-d560ba88060c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 3e617476-1bcd-49f6-b16b-1513445fc759] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:46.237102 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e6722035-601f-4ca9-869d-d560ba88060c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:46.237646 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e6722035-601f-4ca9-869d-d560ba88060c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:46.238428 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e6722035-601f-4ca9-869d-d560ba88060c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:46.238866 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e6722035-601f-4ca9-869d-d560ba88060c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:46.473639 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-e6722035-601f-4ca9-869d-d560ba88060c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:46.491474 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-e6722035-601f-4ca9-869d-d560ba88060c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759" status: 200 len: 1521 microversion: 2.1 time: 0.268344 May 26 18:03:46.492672 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 166/309] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:46 2022] GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759 => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:46.978570 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-ce257901-a83e-4883-82d8-386366184239 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:46.980328 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-ce257901-a83e-4883-82d8-386366184239 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:46.989992 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ce257901-a83e-4883-82d8-386366184239 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:46.990881 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ce257901-a83e-4883-82d8-386366184239 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:46.991834 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ce257901-a83e-4883-82d8-386366184239 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:46.992301 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ce257901-a83e-4883-82d8-386366184239 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:47.033472 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-1b45edfc-d699-4881-a76a-e2afe3c91d0d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:47.034959 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-1b45edfc-d699-4881-a76a-e2afe3c91d0d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:47.042944 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-1b45edfc-d699-4881-a76a-e2afe3c91d0d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:47.043977 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-1b45edfc-d699-4881-a76a-e2afe3c91d0d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:47.046298 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-1b45edfc-d699-4881-a76a-e2afe3c91d0d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:47.047187 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-1b45edfc-d699-4881-a76a-e2afe3c91d0d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:47.159880 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-ce257901-a83e-4883-82d8-386366184239 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:47.169163 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-ce257901-a83e-4883-82d8-386366184239 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1721 microversion: 2.1 time: 0.194481 May 26 18:03:47.172506 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 144/310] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:46 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1721 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:47.443590 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-1b45edfc-d699-4881-a76a-e2afe3c91d0d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:47.454130 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-1b45edfc-d699-4881-a76a-e2afe3c91d0d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:47.456921 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-1b45edfc-d699-4881-a76a-e2afe3c91d0d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:47.458660 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-1b45edfc-d699-4881-a76a-e2afe3c91d0d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1744 microversion: 2.20 time: 0.430943 May 26 18:03:47.460345 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 167/311] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:03:47 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1744 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:03:47.516224 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-ddf007e1-ba0f-40b9-a74c-b6640cc61ec5 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:47.517610 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-ddf007e1-ba0f-40b9-a74c-b6640cc61ec5 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 3e617476-1bcd-49f6-b16b-1513445fc759] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:47.528910 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ddf007e1-ba0f-40b9-a74c-b6640cc61ec5 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:47.530033 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ddf007e1-ba0f-40b9-a74c-b6640cc61ec5 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:47.531799 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ddf007e1-ba0f-40b9-a74c-b6640cc61ec5 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:47.532693 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ddf007e1-ba0f-40b9-a74c-b6640cc61ec5 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:47.694753 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-ddf007e1-ba0f-40b9-a74c-b6640cc61ec5 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:47.705477 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-ddf007e1-ba0f-40b9-a74c-b6640cc61ec5 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759" status: 200 len: 1501 microversion: 2.1 time: 0.198596 May 26 18:03:47.718367 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 145/312] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:47 2022] GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759 => generated 1501 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:47.724278 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-212a19b8-eff2-4471-9ef0-46fe86755e29 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "acb53a32-f1ca-435b-a848-6d193c7f95af"}} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:03:47.725686 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-212a19b8-eff2-4471-9ef0-46fe86755e29 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 3e617476-1bcd-49f6-b16b-1513445fc759] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:47.731391 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-53afa3b0-ac2e-4b78-b667-e34b5dedb953 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:47.732696 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-53afa3b0-ac2e-4b78-b667-e34b5dedb953 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] [instance: cd2fb019-75ed-45ea-948b-64a627396f02] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:47.736637 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-212a19b8-eff2-4471-9ef0-46fe86755e29 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:47.737598 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-212a19b8-eff2-4471-9ef0-46fe86755e29 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:47.739229 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-212a19b8-eff2-4471-9ef0-46fe86755e29 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:47.739800 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-212a19b8-eff2-4471-9ef0-46fe86755e29 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:47.741006 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-53afa3b0-ac2e-4b78-b667-e34b5dedb953 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:47.741626 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-53afa3b0-ac2e-4b78-b667-e34b5dedb953 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:47.742391 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-53afa3b0-ac2e-4b78-b667-e34b5dedb953 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:47.743033 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-53afa3b0-ac2e-4b78-b667-e34b5dedb953 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:47.781266 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.wsgi [None req-212a19b8-eff2-4471-9ef0-46fe86755e29 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] HTTP exception thrown: Cannot 'attach_volume' instance 3e617476-1bcd-49f6-b16b-1513445fc759 while it is in vm_state rescued May 26 18:03:47.784611 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-212a19b8-eff2-4471-9ef0-46fe86755e29 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Request method failure captured: May 26 18:03:47.784611 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: request: POST /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759/os-volume_attachments HTTP/1.1 May 26 18:03:47.784611 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Accept: application/json May 26 18:03:47.784611 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Accept-Encoding: identity May 26 18:03:47.784611 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Connection: close May 26 18:03:47.784611 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Content-Length: 74 May 26 18:03:47.784611 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Content-Type: application/json May 26 18:03:47.784611 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Host: 10.222.0.69 May 26 18:03:47.784611 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Openstack-System-Scope: None May 26 18:03:47.784611 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: User-Agent: python-urllib3/1.26.9 May 26 18:03:47.784611 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Auth-Token: gAAAAABij8CEaLy0mIY1rbl58rC9P5zQJt3SdA29iT72yPdbP2A1cZkxmYRESeVBN9npB9Fyh-TEA-fQEqHl8bqgiGsn4EJRSEgZQOIOcnpWWnEUJaD6JqRSmdBSMdFWgTLV5TzEuYe-QdEGVEJ4qH0zXg8eK_viVaqviW5ytzmptISabYMrRrw May 26 18:03:47.784611 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Domain-Id: None May 26 18:03:47.784611 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Domain-Name: None May 26 18:03:47.784611 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Identity-Status: Confirmed May 26 18:03:47.784611 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Is-Admin-Project: True May 26 18:03:47.784611 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Domain-Id: default May 26 18:03:47.784611 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Domain-Name: Default May 26 18:03:47.784611 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Id: 53288d567a8f426bb068908db481e32e May 26 18:03:47.784611 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-48273316 May 26 18:03:47.784611 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Role: member,reader May 26 18:03:47.784611 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Roles: member,reader May 26 18:03:47.785917 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/53288d567a8f426bb068908db481e32e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/53288d567a8f426bb068908db481e32e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/53288d567a8f426bb068908db481e32e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_53288d567a8f426bb068908db481e32e"}]}] May 26 18:03:47.785917 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant: tempest-ServerRescueNegativeTestJSON-48273316 May 26 18:03:47.785917 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant-Id: 53288d567a8f426bb068908db481e32e May 26 18:03:47.785917 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-48273316 May 26 18:03:47.785917 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User: tempest-ServerRescueNegativeTestJSON-48273316-project May 26 18:03:47.785917 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Domain-Id: default May 26 18:03:47.785917 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Domain-Name: Default May 26 18:03:47.785917 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Id: 5b5c8dedd274447da8ee4600feb6a26c May 26 18:03:47.785917 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Name: tempest-ServerRescueNegativeTestJSON-48273316-project May 26 18:03:47.785917 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: May 26 18:03:47.785917 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: {"volumeAttachment": {"volumeId": "acb53a32-f1ca-435b-a848-6d193c7f95af"}} May 26 18:03:47.785917 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: method: > May 26 18:03:47.786642 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: exception: Cannot 'attach_volume' instance 3e617476-1bcd-49f6-b16b-1513445fc759 while it is in vm_state rescued May 26 18:03:47.786642 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: action_args: {'server_id': '3e617476-1bcd-49f6-b16b-1513445fc759', 'body': {'volumeAttachment': {'volumeId': 'acb53a32-f1ca-435b-a848-6d193c7f95af'}}} May 26 18:03:47.786642 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:03:47.786642 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:03:47.786642 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 26 18:03:47.786642 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 26 18:03:47.786642 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 18:03:47.786642 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 18:03:47.786642 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 26 18:03:47.786642 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 26 18:03:47.786642 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3e617476-1bcd-49f6-b16b-1513445fc759 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 26 18:03:47.786642 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:03:47.786642 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:03:47.786642 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:03:47.786642 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:03:47.786642 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:03:47.786642 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:03:47.786642 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:03:47.786642 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:03:47.787727 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:03:47.787727 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:03:47.787727 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 18:03:47.787727 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 18:03:47.787727 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 18:03:47.787727 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 18:03:47.787727 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 18:03:47.787727 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 18:03:47.787727 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 26 18:03:47.787727 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 26 18:03:47.787727 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 26 18:03:47.787727 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 26 18:03:47.787727 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 3e617476-1bcd-49f6-b16b-1513445fc759 while it is in vm_state rescued May 26 18:03:47.787727 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:03:47.787727 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:03:47.787727 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:03:47.787727 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:03:47.787727 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:03:47.787727 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:03:47.792516 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:03:47.792516 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:03:47.792516 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 3e617476-1bcd-49f6-b16b-1513445fc759 while it is in vm_state rescued May 26 18:03:47.792516 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:03:47.792516 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-212a19b8-eff2-4471-9ef0-46fe86755e29 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Returning 409 to user: Cannot 'attach_volume' instance 3e617476-1bcd-49f6-b16b-1513445fc759 while it is in vm_state rescued {{(pid=117722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:03:47.792516 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-212a19b8-eff2-4471-9ef0-46fe86755e29 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "POST /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.066936 May 26 18:03:47.792516 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 168/313] 10.222.0.69 () {60 vars in 1322 bytes} [Thu May 26 18:03:47 2022] POST /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759/os-volume_attachments => generated 152 bytes in 70 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 26 18:03:47.802764 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-4f808a51-d7e2-4d4e-81e0-801ddaa2152f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:03:47.803424 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-4f808a51-d7e2-4d4e-81e0-801ddaa2152f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 3e617476-1bcd-49f6-b16b-1513445fc759] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:47.816035 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-4f808a51-d7e2-4d4e-81e0-801ddaa2152f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:47.816698 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-4f808a51-d7e2-4d4e-81e0-801ddaa2152f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:47.817795 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-4f808a51-d7e2-4d4e-81e0-801ddaa2152f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:47.818513 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-4f808a51-d7e2-4d4e-81e0-801ddaa2152f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:47.933850 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-4f808a51-d7e2-4d4e-81e0-801ddaa2152f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "POST /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759/action" status: 202 len: 0 microversion: 2.1 time: 0.135981 May 26 18:03:47.935083 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 169/314] 10.222.0.69 () {60 vars in 1277 bytes} [Thu May 26 18:03:47 2022] POST /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:03:47.958386 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-bbd43bb4-3141-4b04-a5df-13634bbdca1f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:47.959498 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-bbd43bb4-3141-4b04-a5df-13634bbdca1f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 3e617476-1bcd-49f6-b16b-1513445fc759] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:47.992764 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-bbd43bb4-3141-4b04-a5df-13634bbdca1f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:47.994426 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-bbd43bb4-3141-4b04-a5df-13634bbdca1f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:47.996340 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-bbd43bb4-3141-4b04-a5df-13634bbdca1f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:47.997270 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-bbd43bb4-3141-4b04-a5df-13634bbdca1f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:48.007363 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.objects.instance [None req-53afa3b0-ac2e-4b78-b667-e34b5dedb953 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lazy-loading 'services' on Instance uuid cd2fb019-75ed-45ea-948b-64a627396f02 {{(pid=117723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:03:48.215721 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-53afa3b0-ac2e-4b78-b667-e34b5dedb953 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] 10.222.0.69 "DELETE /compute/v2.1/servers/cd2fb019-75ed-45ea-948b-64a627396f02/os-volume_attachments/8f97d962-86f2-46a3-b102-70d8a6712c9d" status: 202 len: 0 microversion: 2.1 time: 0.488499 May 26 18:03:48.222997 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 146/315] 10.222.0.69 () {58 vars in 1415 bytes} [Thu May 26 18:03:47 2022] DELETE /compute/v2.1/servers/cd2fb019-75ed-45ea-948b-64a627396f02/os-volume_attachments/8f97d962-86f2-46a3-b102-70d8a6712c9d => generated 0 bytes in 496 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:03:48.285969 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-4e4ade47-aea0-415c-9945-0a0b359ee9d7 req-a2f64eb2-6bdf-4d96-b1ff-f7cd4151a0c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "262a4944-6c10-4122-adce-f7780ff4e7a1", "name": "network-vif-plugged", "status": "completed", "tag": "0450cfd2-c365-4788-a3b6-a839770208e7"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:03:48.323886 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-4e4ade47-aea0-415c-9945-0a0b359ee9d7 req-a2f64eb2-6bdf-4d96-b1ff-f7cd4151a0c0 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:48.326535 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-4e4ade47-aea0-415c-9945-0a0b359ee9d7 req-a2f64eb2-6bdf-4d96-b1ff-f7cd4151a0c0 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:48.359352 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-4e4ade47-aea0-415c-9945-0a0b359ee9d7 req-a2f64eb2-6bdf-4d96-b1ff-f7cd4151a0c0 service nova] Creating event network-vif-plugged:0450cfd2-c365-4788-a3b6-a839770208e7 for instance 262a4944-6c10-4122-adce-f7780ff4e7a1 on hv-cinder-83607 May 26 18:03:48.361656 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-bbd43bb4-3141-4b04-a5df-13634bbdca1f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:48.366981 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-4e4ade47-aea0-415c-9945-0a0b359ee9d7 req-a2f64eb2-6bdf-4d96-b1ff-f7cd4151a0c0 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124788 May 26 18:03:48.380032 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-bbd43bb4-3141-4b04-a5df-13634bbdca1f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759" status: 200 len: 1509 microversion: 2.1 time: 0.435760 May 26 18:03:48.380975 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 170/316] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:47 2022] GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759 => generated 1509 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:48.383583 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 147/317] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:03:48.389479 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-307d8ad7-ac05-49a1-b631-da4f986465af tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:48.390134 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-307d8ad7-ac05-49a1-b631-da4f986465af tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:48.410063 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-307d8ad7-ac05-49a1-b631-da4f986465af tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:48.410700 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-307d8ad7-ac05-49a1-b631-da4f986465af tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:48.411838 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-307d8ad7-ac05-49a1-b631-da4f986465af tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:48.412467 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-307d8ad7-ac05-49a1-b631-da4f986465af tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:48.483308 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-362d1dd0-55a3-4a13-bde6-513154d6ed51 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:48.484142 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-362d1dd0-55a3-4a13-bde6-513154d6ed51 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:48.491936 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-362d1dd0-55a3-4a13-bde6-513154d6ed51 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:48.492728 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-362d1dd0-55a3-4a13-bde6-513154d6ed51 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:48.493727 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-362d1dd0-55a3-4a13-bde6-513154d6ed51 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:48.494402 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-362d1dd0-55a3-4a13-bde6-513154d6ed51 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:48.672888 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-362d1dd0-55a3-4a13-bde6-513154d6ed51 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:48.683535 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-362d1dd0-55a3-4a13-bde6-513154d6ed51 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:48.686190 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-362d1dd0-55a3-4a13-bde6-513154d6ed51 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:48.688037 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-362d1dd0-55a3-4a13-bde6-513154d6ed51 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1744 microversion: 2.20 time: 0.210526 May 26 18:03:48.688706 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 148/318] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:03:48 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1744 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:03:48.693795 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-307d8ad7-ac05-49a1-b631-da4f986465af tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:48.696295 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:03:48.704452 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-307d8ad7-ac05-49a1-b631-da4f986465af tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1721 microversion: 2.1 time: 0.322278 May 26 18:03:48.705154 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 171/319] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:48 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1721 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:49.402692 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-6c88f6a2-c164-4284-891b-f3c0956c8ebe tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:49.406653 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-6c88f6a2-c164-4284-891b-f3c0956c8ebe tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 3e617476-1bcd-49f6-b16b-1513445fc759] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:49.421286 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6c88f6a2-c164-4284-891b-f3c0956c8ebe tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:49.421972 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6c88f6a2-c164-4284-891b-f3c0956c8ebe tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:49.424465 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6c88f6a2-c164-4284-891b-f3c0956c8ebe tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:49.425177 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6c88f6a2-c164-4284-891b-f3c0956c8ebe tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:49.440770 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:03:49.708596 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-fde3217d-6fd5-42e6-b187-9d9bc454fc53 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:49.711007 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-fde3217d-6fd5-42e6-b187-9d9bc454fc53 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:49.761347 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-fde3217d-6fd5-42e6-b187-9d9bc454fc53 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:49.767952 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-fde3217d-6fd5-42e6-b187-9d9bc454fc53 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:49.770065 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-fde3217d-6fd5-42e6-b187-9d9bc454fc53 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:49.774464 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-fde3217d-6fd5-42e6-b187-9d9bc454fc53 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:49.938830 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-6c88f6a2-c164-4284-891b-f3c0956c8ebe tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:49.951401 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-6c88f6a2-c164-4284-891b-f3c0956c8ebe tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759" status: 200 len: 1509 microversion: 2.1 time: 0.551905 May 26 18:03:49.953108 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 149/320] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:49 2022] GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759 => generated 1509 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:49.968614 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-3707a06d-afd7-4b5b-a8a9-27e3449196e4 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:49.969353 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-3707a06d-afd7-4b5b-a8a9-27e3449196e4 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:49.994109 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3707a06d-afd7-4b5b-a8a9-27e3449196e4 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:49.995525 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3707a06d-afd7-4b5b-a8a9-27e3449196e4 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:49.996773 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3707a06d-afd7-4b5b-a8a9-27e3449196e4 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:49.997532 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3707a06d-afd7-4b5b-a8a9-27e3449196e4 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:50.204712 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-fde3217d-6fd5-42e6-b187-9d9bc454fc53 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:50.214124 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-fde3217d-6fd5-42e6-b187-9d9bc454fc53 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:50.219092 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-fde3217d-6fd5-42e6-b187-9d9bc454fc53 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:50.223680 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-fde3217d-6fd5-42e6-b187-9d9bc454fc53 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1739 microversion: 2.20 time: 0.520385 May 26 18:03:50.226517 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 172/321] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:03:49 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1739 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:03:50.264860 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-3707a06d-afd7-4b5b-a8a9-27e3449196e4 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:50.300736 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-3707a06d-afd7-4b5b-a8a9-27e3449196e4 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1721 microversion: 2.1 time: 0.337315 May 26 18:03:50.316990 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 150/322] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:49 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1721 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:50.567090 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-2b106537-a7ec-49d0-82f4-f2035b5363f3 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:50.567952 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-2b106537-a7ec-49d0-82f4-f2035b5363f3 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] [instance: cd2fb019-75ed-45ea-948b-64a627396f02] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:50.576832 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-2b106537-a7ec-49d0-82f4-f2035b5363f3 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:50.578454 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-2b106537-a7ec-49d0-82f4-f2035b5363f3 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:50.579632 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-2b106537-a7ec-49d0-82f4-f2035b5363f3 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:50.581145 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-2b106537-a7ec-49d0-82f4-f2035b5363f3 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:50.615332 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-2b106537-a7ec-49d0-82f4-f2035b5363f3 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] [instance: cd2fb019-75ed-45ea-948b-64a627396f02] Going to try to terminate instance {{(pid=117722) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:03:50.772107 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-2b106537-a7ec-49d0-82f4-f2035b5363f3 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] 10.222.0.69 "DELETE /compute/v2.1/servers/cd2fb019-75ed-45ea-948b-64a627396f02" status: 204 len: 0 microversion: 2.1 time: 0.208752 May 26 18:03:50.785801 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-b4e406fc-1178-4b29-930e-a1ef13d615c3 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:50.787066 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-b4e406fc-1178-4b29-930e-a1ef13d615c3 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] [instance: cd2fb019-75ed-45ea-948b-64a627396f02] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:50.789989 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 173/323] 10.222.0.69 () {58 vars in 1238 bytes} [Thu May 26 18:03:50 2022] DELETE /compute/v2.1/servers/cd2fb019-75ed-45ea-948b-64a627396f02 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 18:03:50.797590 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b4e406fc-1178-4b29-930e-a1ef13d615c3 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:50.798059 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b4e406fc-1178-4b29-930e-a1ef13d615c3 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:50.798864 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b4e406fc-1178-4b29-930e-a1ef13d615c3 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:50.799308 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b4e406fc-1178-4b29-930e-a1ef13d615c3 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:50.981238 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-500c3e73-a2cf-4702-9065-959b388be275 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:50.982620 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-500c3e73-a2cf-4702-9065-959b388be275 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 3e617476-1bcd-49f6-b16b-1513445fc759] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:51.004646 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-500c3e73-a2cf-4702-9065-959b388be275 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:51.007881 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-500c3e73-a2cf-4702-9065-959b388be275 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:51.009939 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-500c3e73-a2cf-4702-9065-959b388be275 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:51.012692 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-500c3e73-a2cf-4702-9065-959b388be275 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:51.222239 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-b4e406fc-1178-4b29-930e-a1ef13d615c3 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b8f37c287341848d8d3b4d5f62873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fdf6152e6874f78825e5eddb7f14158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:51.238962 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-b4e406fc-1178-4b29-930e-a1ef13d615c3 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] 10.222.0.69 "GET /compute/v2.1/servers/cd2fb019-75ed-45ea-948b-64a627396f02" status: 200 len: 1515 microversion: 2.1 time: 0.459209 May 26 18:03:51.240558 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 151/324] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:50 2022] GET /compute/v2.1/servers/cd2fb019-75ed-45ea-948b-64a627396f02 => generated 1515 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:51.265902 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-a5fc4ebd-2f72-44f5-9e89-a6d57d2bdf0f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:51.267854 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-a5fc4ebd-2f72-44f5-9e89-a6d57d2bdf0f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:51.287258 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a5fc4ebd-2f72-44f5-9e89-a6d57d2bdf0f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:51.289858 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a5fc4ebd-2f72-44f5-9e89-a6d57d2bdf0f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:51.291182 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a5fc4ebd-2f72-44f5-9e89-a6d57d2bdf0f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:51.299547 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a5fc4ebd-2f72-44f5-9e89-a6d57d2bdf0f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:51.597960 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-a5fc4ebd-2f72-44f5-9e89-a6d57d2bdf0f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:51.608583 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-500c3e73-a2cf-4702-9065-959b388be275 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:51.614083 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-a5fc4ebd-2f72-44f5-9e89-a6d57d2bdf0f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:51.615639 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-a5fc4ebd-2f72-44f5-9e89-a6d57d2bdf0f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:51.616880 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-a5fc4ebd-2f72-44f5-9e89-a6d57d2bdf0f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1739 microversion: 2.20 time: 0.359232 May 26 18:03:51.618818 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-500c3e73-a2cf-4702-9065-959b388be275 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759" status: 200 len: 1509 microversion: 2.1 time: 0.645319 May 26 18:03:51.628823 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 174/325] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:50 2022] GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759 => generated 1509 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:51.633882 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-914d9c39-222e-49fd-bb4c-a63e48b3df43 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:51.634767 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-914d9c39-222e-49fd-bb4c-a63e48b3df43 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:51.637607 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 152/326] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:03:51 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1739 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:03:51.653453 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-914d9c39-222e-49fd-bb4c-a63e48b3df43 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:51.654639 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-914d9c39-222e-49fd-bb4c-a63e48b3df43 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:51.655762 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-914d9c39-222e-49fd-bb4c-a63e48b3df43 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:51.656432 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-914d9c39-222e-49fd-bb4c-a63e48b3df43 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:52.134317 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-914d9c39-222e-49fd-bb4c-a63e48b3df43 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:52.183224 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-914d9c39-222e-49fd-bb4c-a63e48b3df43 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1721 microversion: 2.1 time: 0.531920 May 26 18:03:52.184412 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 175/327] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:51 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1721 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:52.260157 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-38e493b9-79bf-4a18-b228-cccc712fff44 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:52.261816 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-38e493b9-79bf-4a18-b228-cccc712fff44 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] [instance: cd2fb019-75ed-45ea-948b-64a627396f02] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:52.274538 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-38e493b9-79bf-4a18-b228-cccc712fff44 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:52.275345 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-38e493b9-79bf-4a18-b228-cccc712fff44 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:52.276375 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-38e493b9-79bf-4a18-b228-cccc712fff44 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:52.276996 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-38e493b9-79bf-4a18-b228-cccc712fff44 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:52.640152 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-38e493b9-79bf-4a18-b228-cccc712fff44 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b8f37c287341848d8d3b4d5f62873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fdf6152e6874f78825e5eddb7f14158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:52.649090 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-39fe29fd-ff33-450d-ad4d-1f1b4da17732 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:52.650064 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-39fe29fd-ff33-450d-ad4d-1f1b4da17732 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 3e617476-1bcd-49f6-b16b-1513445fc759] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:52.667774 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-38e493b9-79bf-4a18-b228-cccc712fff44 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] 10.222.0.69 "GET /compute/v2.1/servers/cd2fb019-75ed-45ea-948b-64a627396f02" status: 200 len: 1515 microversion: 2.1 time: 0.412225 May 26 18:03:52.668408 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 153/328] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:52 2022] GET /compute/v2.1/servers/cd2fb019-75ed-45ea-948b-64a627396f02 => generated 1515 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:52.679171 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-39fe29fd-ff33-450d-ad4d-1f1b4da17732 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:52.679636 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-39fe29fd-ff33-450d-ad4d-1f1b4da17732 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:52.680512 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-39fe29fd-ff33-450d-ad4d-1f1b4da17732 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:52.680956 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-39fe29fd-ff33-450d-ad4d-1f1b4da17732 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:52.692924 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-ce10091b-754c-4fcb-a9ff-df0f5a2701dc tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:52.693449 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-ce10091b-754c-4fcb-a9ff-df0f5a2701dc tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:52.730910 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ce10091b-754c-4fcb-a9ff-df0f5a2701dc tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:52.731560 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ce10091b-754c-4fcb-a9ff-df0f5a2701dc tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:52.733103 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ce10091b-754c-4fcb-a9ff-df0f5a2701dc tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:52.733893 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ce10091b-754c-4fcb-a9ff-df0f5a2701dc tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:53.037186 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-ce10091b-754c-4fcb-a9ff-df0f5a2701dc tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:53.062826 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-ce10091b-754c-4fcb-a9ff-df0f5a2701dc tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:53.064390 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-ce10091b-754c-4fcb-a9ff-df0f5a2701dc tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:53.074519 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-ce10091b-754c-4fcb-a9ff-df0f5a2701dc tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1739 microversion: 2.20 time: 0.376714 May 26 18:03:53.085714 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 154/329] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:03:52 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1739 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:03:53.206593 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-f299b444-a10b-4eb4-b762-eeadda8b2f5a tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:53.207465 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-f299b444-a10b-4eb4-b762-eeadda8b2f5a tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:53.218576 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f299b444-a10b-4eb4-b762-eeadda8b2f5a tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:53.219273 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f299b444-a10b-4eb4-b762-eeadda8b2f5a tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:53.220271 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f299b444-a10b-4eb4-b762-eeadda8b2f5a tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:53.221211 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f299b444-a10b-4eb4-b762-eeadda8b2f5a tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:53.356286 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-39fe29fd-ff33-450d-ad4d-1f1b4da17732 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:53.368333 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-39fe29fd-ff33-450d-ad4d-1f1b4da17732 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759" status: 200 len: 1509 microversion: 2.1 time: 0.723212 May 26 18:03:53.372440 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 176/330] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:52 2022] GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759 => generated 1509 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:53.688441 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-053a84d6-cec8-4740-89c0-41a80a48f849 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:53.689326 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-053a84d6-cec8-4740-89c0-41a80a48f849 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] [instance: cd2fb019-75ed-45ea-948b-64a627396f02] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:53.700241 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-053a84d6-cec8-4740-89c0-41a80a48f849 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:53.701620 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-053a84d6-cec8-4740-89c0-41a80a48f849 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:53.702570 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-053a84d6-cec8-4740-89c0-41a80a48f849 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:53.703148 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-053a84d6-cec8-4740-89c0-41a80a48f849 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:53.781070 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-f299b444-a10b-4eb4-b762-eeadda8b2f5a tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:53.803195 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-f299b444-a10b-4eb4-b762-eeadda8b2f5a tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1721 microversion: 2.1 time: 0.602785 May 26 18:03:53.804823 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 155/331] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:53 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1721 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:03:54.108919 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-cb159ace-f8a6-4992-a798-b753ede6cff3 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:54.109854 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-cb159ace-f8a6-4992-a798-b753ede6cff3 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:54.118950 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-cb159ace-f8a6-4992-a798-b753ede6cff3 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:54.119630 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-cb159ace-f8a6-4992-a798-b753ede6cff3 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:54.120625 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-cb159ace-f8a6-4992-a798-b753ede6cff3 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:54.121222 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-cb159ace-f8a6-4992-a798-b753ede6cff3 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:54.395719 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-053a84d6-cec8-4740-89c0-41a80a48f849 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b8f37c287341848d8d3b4d5f62873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fdf6152e6874f78825e5eddb7f14158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:54.415001 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-053a84d6-cec8-4740-89c0-41a80a48f849 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] 10.222.0.69 "GET /compute/v2.1/servers/cd2fb019-75ed-45ea-948b-64a627396f02" status: 200 len: 1515 microversion: 2.1 time: 0.733436 May 26 18:03:54.417202 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 177/332] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:53 2022] GET /compute/v2.1/servers/cd2fb019-75ed-45ea-948b-64a627396f02 => generated 1515 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:03:54.433919 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-4fe9df8e-d794-452f-92fa-8c375f311df5 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:54.434848 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-4fe9df8e-d794-452f-92fa-8c375f311df5 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 3e617476-1bcd-49f6-b16b-1513445fc759] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:54.449742 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-4fe9df8e-d794-452f-92fa-8c375f311df5 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:54.450202 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-4fe9df8e-d794-452f-92fa-8c375f311df5 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:54.451570 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-4fe9df8e-d794-452f-92fa-8c375f311df5 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:54.452096 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-4fe9df8e-d794-452f-92fa-8c375f311df5 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:54.945782 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-4fe9df8e-d794-452f-92fa-8c375f311df5 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:54.956510 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-4fe9df8e-d794-452f-92fa-8c375f311df5 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759" status: 200 len: 1515 microversion: 2.1 time: 0.537968 May 26 18:03:54.957770 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 178/333] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:54 2022] GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759 => generated 1515 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:54.963684 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-0d1d71bf-dc93-43c0-8a91-bf7afc0cb527 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:54.964666 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-0d1d71bf-dc93-43c0-8a91-bf7afc0cb527 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:54.986418 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0d1d71bf-dc93-43c0-8a91-bf7afc0cb527 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:54.986917 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0d1d71bf-dc93-43c0-8a91-bf7afc0cb527 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:54.987779 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0d1d71bf-dc93-43c0-8a91-bf7afc0cb527 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:54.988258 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0d1d71bf-dc93-43c0-8a91-bf7afc0cb527 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:55.298453 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-0d1d71bf-dc93-43c0-8a91-bf7afc0cb527 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:55.311365 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-cb159ace-f8a6-4992-a798-b753ede6cff3 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:55.314535 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-0d1d71bf-dc93-43c0-8a91-bf7afc0cb527 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1721 microversion: 2.1 time: 0.355244 May 26 18:03:55.315491 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 179/334] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:54 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1721 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:55.331018 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-cb159ace-f8a6-4992-a798-b753ede6cff3 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:55.332626 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-cb159ace-f8a6-4992-a798-b753ede6cff3 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:55.334385 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-cb159ace-f8a6-4992-a798-b753ede6cff3 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1739 microversion: 2.20 time: 1.246461 May 26 18:03:55.349014 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 156/335] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:03:54 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1739 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:03:55.433326 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-572fff0e-a0db-499c-911a-691f61750989 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:55.433972 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-572fff0e-a0db-499c-911a-691f61750989 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] [instance: cd2fb019-75ed-45ea-948b-64a627396f02] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:55.444874 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-572fff0e-a0db-499c-911a-691f61750989 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:55.445333 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-572fff0e-a0db-499c-911a-691f61750989 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:55.452948 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-572fff0e-a0db-499c-911a-691f61750989 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:55.453769 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-572fff0e-a0db-499c-911a-691f61750989 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:55.652619 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-572fff0e-a0db-499c-911a-691f61750989 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b8f37c287341848d8d3b4d5f62873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fdf6152e6874f78825e5eddb7f14158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:55.675007 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-572fff0e-a0db-499c-911a-691f61750989 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] 10.222.0.69 "GET /compute/v2.1/servers/cd2fb019-75ed-45ea-948b-64a627396f02" status: 200 len: 1473 microversion: 2.1 time: 0.246251 May 26 18:03:55.688109 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 180/336] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:55 2022] GET /compute/v2.1/servers/cd2fb019-75ed-45ea-948b-64a627396f02 => generated 1473 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:03:55.745619 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-99dc761a-3b08-4b35-8345-4a6cee2e350d req-d41c3258-1497-4e83-8a05-5c1b486651b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd2fb019-75ed-45ea-948b-64a627396f02", "name": "network-vif-deleted", "tag": "e0546b1b-f912-4448-b796-b315d44f6acb"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:03:55.768364 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-99dc761a-3b08-4b35-8345-4a6cee2e350d req-d41c3258-1497-4e83-8a05-5c1b486651b0 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:55.768812 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-99dc761a-3b08-4b35-8345-4a6cee2e350d req-d41c3258-1497-4e83-8a05-5c1b486651b0 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:55.831575 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-99dc761a-3b08-4b35-8345-4a6cee2e350d req-d41c3258-1497-4e83-8a05-5c1b486651b0 service nova] Creating event network-vif-deleted:e0546b1b-f912-4448-b796-b315d44f6acb for instance cd2fb019-75ed-45ea-948b-64a627396f02 on hv-cinder-83607 May 26 18:03:55.851352 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-99dc761a-3b08-4b35-8345-4a6cee2e350d req-d41c3258-1497-4e83-8a05-5c1b486651b0 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109080 May 26 18:03:55.852980 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 157/337] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:03:56.338566 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-9d9a9166-544a-4319-a364-3cfff7df497f tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:56.339707 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-9d9a9166-544a-4319-a364-3cfff7df497f tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:56.358989 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-e175ab0a-eec3-472d-918d-8b9cb0aed953 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:56.362025 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-e175ab0a-eec3-472d-918d-8b9cb0aed953 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:56.372878 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-9d9a9166-544a-4319-a364-3cfff7df497f tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:56.377026 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-9d9a9166-544a-4319-a364-3cfff7df497f tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:56.380378 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-9d9a9166-544a-4319-a364-3cfff7df497f tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:56.381557 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-9d9a9166-544a-4319-a364-3cfff7df497f tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:56.384767 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e175ab0a-eec3-472d-918d-8b9cb0aed953 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:56.385465 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e175ab0a-eec3-472d-918d-8b9cb0aed953 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:56.388212 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e175ab0a-eec3-472d-918d-8b9cb0aed953 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:56.389010 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e175ab0a-eec3-472d-918d-8b9cb0aed953 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:56.689946 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-e175ab0a-eec3-472d-918d-8b9cb0aed953 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:56.702625 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-e175ab0a-eec3-472d-918d-8b9cb0aed953 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:56.704569 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-e175ab0a-eec3-472d-918d-8b9cb0aed953 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:56.706000 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-e175ab0a-eec3-472d-918d-8b9cb0aed953 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1739 microversion: 2.20 time: 0.355285 May 26 18:03:56.707648 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 158/338] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:03:56 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1739 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:03:56.714361 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-55ad7f1b-8cef-420d-9b4d-eab1fc5006b6 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:56.715285 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-55ad7f1b-8cef-420d-9b4d-eab1fc5006b6 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] [instance: cd2fb019-75ed-45ea-948b-64a627396f02] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:56.723313 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-55ad7f1b-8cef-420d-9b4d-eab1fc5006b6 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:56.724246 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-55ad7f1b-8cef-420d-9b4d-eab1fc5006b6 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:56.725316 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-55ad7f1b-8cef-420d-9b4d-eab1fc5006b6 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:56.725957 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-55ad7f1b-8cef-420d-9b4d-eab1fc5006b6 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:56.755521 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.wsgi [None req-55ad7f1b-8cef-420d-9b4d-eab1fc5006b6 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] HTTP exception thrown: Instance cd2fb019-75ed-45ea-948b-64a627396f02 could not be found. May 26 18:03:56.759819 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-9d9a9166-544a-4319-a364-3cfff7df497f tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:56.773078 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-9d9a9166-544a-4319-a364-3cfff7df497f tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1721 microversion: 2.1 time: 0.441805 May 26 18:03:56.774919 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-55ad7f1b-8cef-420d-9b4d-eab1fc5006b6 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Request method failure captured: May 26 18:03:56.774919 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: request: GET /compute/v2.1/servers/cd2fb019-75ed-45ea-948b-64a627396f02 HTTP/1.1 May 26 18:03:56.774919 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Accept: application/json May 26 18:03:56.774919 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Accept-Encoding: identity May 26 18:03:56.774919 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Connection: close May 26 18:03:56.774919 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Content-Length: 0 May 26 18:03:56.774919 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Content-Type: application/json May 26 18:03:56.774919 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Host: 10.222.0.69 May 26 18:03:56.774919 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Openstack-System-Scope: None May 26 18:03:56.774919 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: User-Agent: python-urllib3/1.26.9 May 26 18:03:56.774919 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Auth-Token: gAAAAABij8C_eJ1QYUFkI8nLGOhiJpe-o8_DiPshgLiUa7rTfNnYfBmurfpJGxclb5lZAQEboaF2pfL2UXjGM1Y-PMtrcUO67XjqvYY_PC_RfGInVC1fZuyq6H-eV5ztMD5W96EeseUHtGJOUMhAHCXf-QkuUeCUV2WnBFlI6yrpQtKs2JUPv18 May 26 18:03:56.774919 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Domain-Id: None May 26 18:03:56.774919 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Domain-Name: None May 26 18:03:56.774919 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Identity-Status: Confirmed May 26 18:03:56.774919 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Is-Admin-Project: True May 26 18:03:56.774919 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Domain-Id: default May 26 18:03:56.774919 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Domain-Name: Default May 26 18:03:56.774919 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Id: 9fdf6152e6874f78825e5eddb7f14158 May 26 18:03:56.774919 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Name: tempest-VolumesSnapshotTestJSON-158119209 May 26 18:03:56.774919 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Role: member,reader May 26 18:03:56.774919 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Roles: member,reader May 26 18:03:56.776555 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9fdf6152e6874f78825e5eddb7f14158"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9fdf6152e6874f78825e5eddb7f14158"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9fdf6152e6874f78825e5eddb7f14158"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9fdf6152e6874f78825e5eddb7f14158"}]}] May 26 18:03:56.776555 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant: tempest-VolumesSnapshotTestJSON-158119209 May 26 18:03:56.776555 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant-Id: 9fdf6152e6874f78825e5eddb7f14158 May 26 18:03:56.776555 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-158119209 May 26 18:03:56.776555 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User: tempest-VolumesSnapshotTestJSON-158119209-project May 26 18:03:56.776555 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Domain-Id: default May 26 18:03:56.776555 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Domain-Name: Default May 26 18:03:56.776555 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Id: f8b8f37c287341848d8d3b4d5f62873d May 26 18:03:56.776555 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Name: tempest-VolumesSnapshotTestJSON-158119209-project May 26 18:03:56.776555 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: method: > May 26 18:03:56.776555 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: exception: Instance cd2fb019-75ed-45ea-948b-64a627396f02 could not be found. May 26 18:03:56.776555 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: action_args: {'id': 'cd2fb019-75ed-45ea-948b-64a627396f02'} May 26 18:03:56.777264 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:03:56.777264 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:03:56.777264 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:03:56.777264 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:03:56.777264 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:03:56.777264 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:03:56.777264 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:03:56.777264 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:03:56.777264 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:03:56.777264 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:03:56.777264 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd2fb019-75ed-45ea-948b-64a627396f02 could not be found. May 26 18:03:56.777264 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:03:56.777264 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:03:56.777264 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:03:56.777264 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:03:56.777264 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:03:56.777264 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:03:56.777264 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:03:56.777264 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:03:56.777264 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:03:56.778969 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:03:56.778969 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:03:56.778969 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:03:56.778969 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:03:56.778969 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:03:56.778969 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:03:56.778969 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:03:56.778969 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd2fb019-75ed-45ea-948b-64a627396f02 could not be found. May 26 18:03:56.778969 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:03:56.778969 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:03:56.778969 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:03:56.778969 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:03:56.778969 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:03:56.778969 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:03:56.778969 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:03:56.778969 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:03:56.778969 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd2fb019-75ed-45ea-948b-64a627396f02 could not be found. May 26 18:03:56.778969 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:03:56.784611 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 181/339] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:56 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1721 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:56.785177 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-55ad7f1b-8cef-420d-9b4d-eab1fc5006b6 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Returning 404 to user: Instance cd2fb019-75ed-45ea-948b-64a627396f02 could not be found. {{(pid=117723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:03:56.786463 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-55ad7f1b-8cef-420d-9b4d-eab1fc5006b6 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] 10.222.0.69 "GET /compute/v2.1/servers/cd2fb019-75ed-45ea-948b-64a627396f02" status: 404 len: 111 microversion: 2.1 time: 0.077597 May 26 18:03:56.787989 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 159/340] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:56 2022] GET /compute/v2.1/servers/cd2fb019-75ed-45ea-948b-64a627396f02 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:03:56.955132 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-5ad137f5-bdbd-46e1-9226-a5229ae71a5f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Action: 'create', calling method: .version_select at 0x7f3ab8c3dc10>, body: {"keypair": {"name": "tempest-keypair-508299147", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHdSBLsCqlOASXVwmD+nUMZCoSccs7acjaICvGh3Bmk9xhVTDFC2x8WCJwUOB805C2kGXHOxtu/UWp3Zd708OQI2H3EaIQfM647QcCbuve2MUOodIZUG+HvKe1spIFicXQ=="}} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:03:56.993323 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.quota [None req-5ad137f5-bdbd-46e1-9226-a5229ae71a5f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Getting quotas for project 53288d567a8f426bb068908db481e32e. Resources: {'key_pairs'} {{(pid=117722) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:03:57.006574 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.quota [None req-5ad137f5-bdbd-46e1-9226-a5229ae71a5f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Getting quotas for user 5b5c8dedd274447da8ee4600feb6a26c and project 53288d567a8f426bb068908db481e32e. Resources: {'key_pairs'} {{(pid=117722) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:03:57.098256 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-5ad137f5-bdbd-46e1-9226-a5229ae71a5f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.158874 May 26 18:03:57.108773 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 182/341] 10.222.0.69 () {60 vars in 1158 bytes} [Thu May 26 18:03:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:03:57.765917 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-54e9263f-9adc-4981-a138-0958c8f122cb tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:57.768703 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-54e9263f-9adc-4981-a138-0958c8f122cb tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:57.811158 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-54e9263f-9adc-4981-a138-0958c8f122cb tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:57.813084 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-54e9263f-9adc-4981-a138-0958c8f122cb tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:57.815277 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-54e9263f-9adc-4981-a138-0958c8f122cb tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:57.816372 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-6e77af34-d56f-4e4d-9eb3-44b378a46e25 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:57.817228 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-54e9263f-9adc-4981-a138-0958c8f122cb tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:57.817740 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-6e77af34-d56f-4e4d-9eb3-44b378a46e25 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:57.830750 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-6e77af34-d56f-4e4d-9eb3-44b378a46e25 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:57.832707 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-6e77af34-d56f-4e4d-9eb3-44b378a46e25 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:57.834162 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-6e77af34-d56f-4e4d-9eb3-44b378a46e25 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:57.836857 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-6e77af34-d56f-4e4d-9eb3-44b378a46e25 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:58.423490 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-6e77af34-d56f-4e4d-9eb3-44b378a46e25 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:58.438956 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-6e77af34-d56f-4e4d-9eb3-44b378a46e25 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1721 microversion: 2.1 time: 0.627238 May 26 18:03:58.439552 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 183/342] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:57 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1721 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:58.488612 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-54e9263f-9adc-4981-a138-0958c8f122cb tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:58.498061 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-54e9263f-9adc-4981-a138-0958c8f122cb tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:58.504993 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-54e9263f-9adc-4981-a138-0958c8f122cb tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:58.506617 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-54e9263f-9adc-4981-a138-0958c8f122cb tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1739 microversion: 2.20 time: 0.759824 May 26 18:03:58.509547 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 160/343] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:03:57 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1739 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:03:59.457658 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-2a630abb-37ca-4a1b-9926-af0e78121af7 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:59.458796 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-2a630abb-37ca-4a1b-9926-af0e78121af7 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:59.476662 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-2a630abb-37ca-4a1b-9926-af0e78121af7 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:59.480295 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-2a630abb-37ca-4a1b-9926-af0e78121af7 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:59.482107 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-2a630abb-37ca-4a1b-9926-af0e78121af7 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:59.484950 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-2a630abb-37ca-4a1b-9926-af0e78121af7 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:59.530118 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-811a77ba-c10a-4090-b00d-20822dff423a tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:59.530863 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-811a77ba-c10a-4090-b00d-20822dff423a tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:59.558190 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-811a77ba-c10a-4090-b00d-20822dff423a tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:59.561130 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-811a77ba-c10a-4090-b00d-20822dff423a tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:59.562197 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-811a77ba-c10a-4090-b00d-20822dff423a tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:59.571575 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-811a77ba-c10a-4090-b00d-20822dff423a tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:59.793364 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-2a630abb-37ca-4a1b-9926-af0e78121af7 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:59.812189 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-2a630abb-37ca-4a1b-9926-af0e78121af7 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1721 microversion: 2.1 time: 0.358650 May 26 18:03:59.818404 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 184/344] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:03:59 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1721 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:00.282290 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-811a77ba-c10a-4090-b00d-20822dff423a tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:00.299067 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-811a77ba-c10a-4090-b00d-20822dff423a tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:00.300722 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-811a77ba-c10a-4090-b00d-20822dff423a tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:00.306664 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-811a77ba-c10a-4090-b00d-20822dff423a tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1739 microversion: 2.20 time: 0.781337 May 26 18:04:00.308752 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 161/345] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:03:59 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1739 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:04:00.837975 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-ead2250a-198c-48af-8623-8bfaf311d787 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:00.838600 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-ead2250a-198c-48af-8623-8bfaf311d787 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:00.854271 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ead2250a-198c-48af-8623-8bfaf311d787 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:00.854736 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ead2250a-198c-48af-8623-8bfaf311d787 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:00.855538 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ead2250a-198c-48af-8623-8bfaf311d787 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:00.863918 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ead2250a-198c-48af-8623-8bfaf311d787 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:01.191681 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-ead2250a-198c-48af-8623-8bfaf311d787 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:01.204906 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-ead2250a-198c-48af-8623-8bfaf311d787 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1721 microversion: 2.1 time: 0.370736 May 26 18:04:01.206087 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 185/346] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:00 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1721 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:01.333655 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-45a27ab3-2f24-4e91-b9cd-236ebc2c1344 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:01.336849 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-45a27ab3-2f24-4e91-b9cd-236ebc2c1344 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:01.348181 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-45a27ab3-2f24-4e91-b9cd-236ebc2c1344 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:01.348644 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-45a27ab3-2f24-4e91-b9cd-236ebc2c1344 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:01.349449 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-45a27ab3-2f24-4e91-b9cd-236ebc2c1344 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:01.349895 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-45a27ab3-2f24-4e91-b9cd-236ebc2c1344 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:01.750771 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-6d688739-5f13-4b0b-ab7f-ebe5fafa3614 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-238014249", "imageRef": "16351c96-cb02-4711-99d5-fd4d80e8a846", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "18d1c3ca-82fe-45c8-9ec5-367933ffa4c4"}], "security_groups": [{"name": "tempest-securitygroup--1216237686"}], "key_name": "tempest-keypair-508299147", "user_data": "}} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:04:01.924513 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.network.neutron [None req-6d688739-5f13-4b0b-ab7f-ebe5fafa3614 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] validate_networks() for [('18d1c3ca-82fe-45c8-9ec5-367933ffa4c4', None, None, None, None, None)] {{(pid=117722) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:04:02.314009 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-45a27ab3-2f24-4e91-b9cd-236ebc2c1344 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:02.323981 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-45a27ab3-2f24-4e91-b9cd-236ebc2c1344 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:02.328164 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-45a27ab3-2f24-4e91-b9cd-236ebc2c1344 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:02.334622 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-45a27ab3-2f24-4e91-b9cd-236ebc2c1344 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1739 microversion: 2.20 time: 1.012483 May 26 18:04:02.336500 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 162/347] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:04:01 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1739 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:02.354869 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-649076df-27b5-44b1-91e6-6b66937c2aa3 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:02.356951 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-649076df-27b5-44b1-91e6-6b66937c2aa3 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:02.373597 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-649076df-27b5-44b1-91e6-6b66937c2aa3 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:02.374368 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-649076df-27b5-44b1-91e6-6b66937c2aa3 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:02.375329 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-649076df-27b5-44b1-91e6-6b66937c2aa3 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:02.375879 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-649076df-27b5-44b1-91e6-6b66937c2aa3 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:02.624521 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.virt.hardware [None req-6d688739-5f13-4b0b-ab7f-ebe5fafa3614 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Flavor limits 0:0:0 {{(pid=117722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:04:02.628551 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.virt.hardware [None req-6d688739-5f13-4b0b-ab7f-ebe5fafa3614 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Image limits 0:0:0 {{(pid=117722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:04:02.629441 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.virt.hardware [None req-6d688739-5f13-4b0b-ab7f-ebe5fafa3614 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Flavor pref 0:0:0 {{(pid=117722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:04:02.630190 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.virt.hardware [None req-6d688739-5f13-4b0b-ab7f-ebe5fafa3614 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Image pref 0:0:0 {{(pid=117722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:04:02.630835 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.virt.hardware [None req-6d688739-5f13-4b0b-ab7f-ebe5fafa3614 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:04:02.652461 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-6d688739-5f13-4b0b-ab7f-ebe5fafa3614 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:02.668099 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-6d688739-5f13-4b0b-ab7f-ebe5fafa3614 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:02.672468 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-6d688739-5f13-4b0b-ab7f-ebe5fafa3614 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:02.680464 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-6d688739-5f13-4b0b-ab7f-ebe5fafa3614 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:02.697687 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-649076df-27b5-44b1-91e6-6b66937c2aa3 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:02.709225 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-649076df-27b5-44b1-91e6-6b66937c2aa3 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1721 microversion: 2.1 time: 0.371361 May 26 18:04:02.710214 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 163/348] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:02 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1721 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:02.721849 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.quota [None req-6d688739-5f13-4b0b-ab7f-ebe5fafa3614 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Getting quotas for project 53288d567a8f426bb068908db481e32e. Resources: {'instances', 'ram', 'cores'} {{(pid=117722) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:04:02.730285 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.quota [None req-6d688739-5f13-4b0b-ab7f-ebe5fafa3614 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Getting quotas for user 5b5c8dedd274447da8ee4600feb6a26c and project 53288d567a8f426bb068908db481e32e. Resources: {'instances', 'ram', 'cores'} {{(pid=117722) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:04:02.744918 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-6d688739-5f13-4b0b-ab7f-ebe5fafa3614 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Going to run 1 instances... {{(pid=117722) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:04:02.749164 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-6d688739-5f13-4b0b-ab7f-ebe5fafa3614 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 704b23df-a1e8-425f-a6bf-4805b1356866] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='16351c96-cb02-4711-99d5-fd4d80e8a846',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:04:02.808803 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-6d688739-5f13-4b0b-ab7f-ebe5fafa3614 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.063469 May 26 18:04:02.810855 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 186/349] 10.222.0.69 () {60 vars in 1146 bytes} [Thu May 26 18:04:01 2022] POST /compute/v2.1/servers => generated 409 bytes in 1066 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 26 18:04:02.822142 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-b57d152b-cce4-4231-a5a7-7a6c66dc539c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:02.823559 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-b57d152b-cce4-4231-a5a7-7a6c66dc539c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 704b23df-a1e8-425f-a6bf-4805b1356866] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:03.074005 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-b57d152b-cce4-4231-a5a7-7a6c66dc539c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:03.101136 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-b57d152b-cce4-4231-a5a7-7a6c66dc539c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866" status: 200 len: 1244 microversion: 2.1 time: 0.273885 May 26 18:04:03.101136 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 164/350] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:02 2022] GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866 => generated 1244 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:03.367065 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-d118037d-753b-4217-9bf0-04486600e22d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:03.368513 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-d118037d-753b-4217-9bf0-04486600e22d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:03.385897 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d118037d-753b-4217-9bf0-04486600e22d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:03.386551 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d118037d-753b-4217-9bf0-04486600e22d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:03.388120 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d118037d-753b-4217-9bf0-04486600e22d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:03.388951 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d118037d-753b-4217-9bf0-04486600e22d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:03.728886 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-b6a151a4-8440-4b61-9203-782d85648b8f tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:03.730282 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-b6a151a4-8440-4b61-9203-782d85648b8f tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:03.738558 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b6a151a4-8440-4b61-9203-782d85648b8f tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:03.739271 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b6a151a4-8440-4b61-9203-782d85648b8f tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:03.740284 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b6a151a4-8440-4b61-9203-782d85648b8f tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:03.740883 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b6a151a4-8440-4b61-9203-782d85648b8f tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:03.901054 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-d118037d-753b-4217-9bf0-04486600e22d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:03.901807 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-d118037d-753b-4217-9bf0-04486600e22d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:03.910266 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-d118037d-753b-4217-9bf0-04486600e22d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:03.911941 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-d118037d-753b-4217-9bf0-04486600e22d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1739 microversion: 2.20 time: 0.551309 May 26 18:04:03.932251 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 187/351] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:04:03 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1739 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:03.963413 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-b6a151a4-8440-4b61-9203-782d85648b8f tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:03.978443 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-b6a151a4-8440-4b61-9203-782d85648b8f tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1721 microversion: 2.1 time: 0.254031 May 26 18:04:03.990874 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 165/352] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:03 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1721 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:04.111770 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-929971c5-fbdd-4758-87b7-ad6af04ce00d tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:04.112589 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-929971c5-fbdd-4758-87b7-ad6af04ce00d tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 704b23df-a1e8-425f-a6bf-4805b1356866] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:04.129476 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-929971c5-fbdd-4758-87b7-ad6af04ce00d tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:04.129918 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-929971c5-fbdd-4758-87b7-ad6af04ce00d tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:04.132770 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-929971c5-fbdd-4758-87b7-ad6af04ce00d tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:04.133239 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-929971c5-fbdd-4758-87b7-ad6af04ce00d tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:04.165362 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:04:04.443447 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-929971c5-fbdd-4758-87b7-ad6af04ce00d tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:04.458294 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-929971c5-fbdd-4758-87b7-ad6af04ce00d tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866" status: 200 len: 1248 microversion: 2.1 time: 0.350564 May 26 18:04:04.459207 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 188/353] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:04 2022] GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866 => generated 1248 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:04.939843 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-42a82549-cbe1-4cfd-96db-5b0d93ade28f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:04.942711 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-42a82549-cbe1-4cfd-96db-5b0d93ade28f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:04.950830 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-42a82549-cbe1-4cfd-96db-5b0d93ade28f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:04.951644 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-42a82549-cbe1-4cfd-96db-5b0d93ade28f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:04.952681 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-42a82549-cbe1-4cfd-96db-5b0d93ade28f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:04.953350 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-42a82549-cbe1-4cfd-96db-5b0d93ade28f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:04.999082 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-be6977f0-1824-45cd-bb5f-8671bab78964 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:04.999992 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-be6977f0-1824-45cd-bb5f-8671bab78964 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:05.022847 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-be6977f0-1824-45cd-bb5f-8671bab78964 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:05.023691 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-be6977f0-1824-45cd-bb5f-8671bab78964 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:05.024701 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-be6977f0-1824-45cd-bb5f-8671bab78964 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:05.025299 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-be6977f0-1824-45cd-bb5f-8671bab78964 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:05.241546 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-42a82549-cbe1-4cfd-96db-5b0d93ade28f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:05.252867 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-42a82549-cbe1-4cfd-96db-5b0d93ade28f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:05.255213 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-42a82549-cbe1-4cfd-96db-5b0d93ade28f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:05.258502 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-42a82549-cbe1-4cfd-96db-5b0d93ade28f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1739 microversion: 2.20 time: 0.323476 May 26 18:04:05.262447 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 166/354] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:04:04 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1739 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:05.476890 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-4ae78a8f-4103-4432-ad30-63c639ec2f0f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:05.477782 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-4ae78a8f-4103-4432-ad30-63c639ec2f0f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 704b23df-a1e8-425f-a6bf-4805b1356866] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:05.494877 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4ae78a8f-4103-4432-ad30-63c639ec2f0f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:05.497746 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4ae78a8f-4103-4432-ad30-63c639ec2f0f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:05.498756 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4ae78a8f-4103-4432-ad30-63c639ec2f0f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:05.499735 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4ae78a8f-4103-4432-ad30-63c639ec2f0f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:05.620545 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-4ae78a8f-4103-4432-ad30-63c639ec2f0f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:05.630253 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-4ae78a8f-4103-4432-ad30-63c639ec2f0f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866" status: 200 len: 1296 microversion: 2.1 time: 0.157391 May 26 18:04:05.631455 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 167/355] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:05 2022] GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866 => generated 1296 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:04:05.682880 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-bd0c61c1-68b4-4033-b5a5-32845b92e6ae tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-603333740", "imageRef": "16351c96-cb02-4711-99d5-fd4d80e8a846", "flavorRef": "452", "networks": [{"uuid": "3c59b880-8c40-4026-aca1-e87d209962e4"}]}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:04:05.784697 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.network.neutron [None req-bd0c61c1-68b4-4033-b5a5-32845b92e6ae tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] validate_networks() for [('3c59b880-8c40-4026-aca1-e87d209962e4', None, None, None, None, None)] {{(pid=117723) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:04:05.961925 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-be6977f0-1824-45cd-bb5f-8671bab78964 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:05.982203 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-be6977f0-1824-45cd-bb5f-8671bab78964 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1721 microversion: 2.1 time: 0.987595 May 26 18:04:05.985393 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 189/356] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:04 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1721 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:06.281222 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-4cc303c5-890f-47ff-b923-3f9f54e61142 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:06.282029 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-4cc303c5-890f-47ff-b923-3f9f54e61142 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:06.301083 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-4cc303c5-890f-47ff-b923-3f9f54e61142 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:06.302275 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-4cc303c5-890f-47ff-b923-3f9f54e61142 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:06.303313 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-4cc303c5-890f-47ff-b923-3f9f54e61142 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:06.303994 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-4cc303c5-890f-47ff-b923-3f9f54e61142 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:06.651331 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-4cc303c5-890f-47ff-b923-3f9f54e61142 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:06.682034 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-4cc303c5-890f-47ff-b923-3f9f54e61142 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:06.686891 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-4cc303c5-890f-47ff-b923-3f9f54e61142 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:06.688647 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-4cc303c5-890f-47ff-b923-3f9f54e61142 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1739 microversion: 2.20 time: 0.412382 May 26 18:04:06.707022 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 190/357] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:04:06 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1739 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:06.719139 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-774c1329-ba3e-4f09-81e7-c83694483d9f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:06.720183 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-774c1329-ba3e-4f09-81e7-c83694483d9f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 704b23df-a1e8-425f-a6bf-4805b1356866] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:06.733150 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-774c1329-ba3e-4f09-81e7-c83694483d9f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:06.733948 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-774c1329-ba3e-4f09-81e7-c83694483d9f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:06.735653 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-774c1329-ba3e-4f09-81e7-c83694483d9f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:06.736557 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-774c1329-ba3e-4f09-81e7-c83694483d9f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:06.798624 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-bd0c61c1-68b4-4033-b5a5-32845b92e6ae tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Flavor limits 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:04:06.799187 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-bd0c61c1-68b4-4033-b5a5-32845b92e6ae tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Image limits 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:04:06.799785 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-bd0c61c1-68b4-4033-b5a5-32845b92e6ae tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Flavor pref 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:04:06.800626 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-bd0c61c1-68b4-4033-b5a5-32845b92e6ae tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Image pref 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:04:06.801077 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-bd0c61c1-68b4-4033-b5a5-32845b92e6ae tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:04:06.805831 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_api:SELECT=80 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:04:06.829419 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-774c1329-ba3e-4f09-81e7-c83694483d9f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:06.833631 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-bd0c61c1-68b4-4033-b5a5-32845b92e6ae tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:06.835029 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-bd0c61c1-68b4-4033-b5a5-32845b92e6ae tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:06.837596 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-774c1329-ba3e-4f09-81e7-c83694483d9f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866" status: 200 len: 1302 microversion: 2.1 time: 0.129101 May 26 18:04:06.838497 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-bd0c61c1-68b4-4033-b5a5-32845b92e6ae tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:06.839096 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-bd0c61c1-68b4-4033-b5a5-32845b92e6ae tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:06.841928 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 191/358] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:06 2022] GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866 => generated 1302 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:06.863170 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=100 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:04:06.881645 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-bd0c61c1-68b4-4033-b5a5-32845b92e6ae tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Getting quotas for project 9fdf6152e6874f78825e5eddb7f14158. Resources: {'instances', 'ram', 'cores'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:04:06.892823 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-bd0c61c1-68b4-4033-b5a5-32845b92e6ae tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Getting quotas for user f8b8f37c287341848d8d3b4d5f62873d and project 9fdf6152e6874f78825e5eddb7f14158. Resources: {'instances', 'ram', 'cores'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:04:06.946176 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-bd0c61c1-68b4-4033-b5a5-32845b92e6ae tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Going to run 1 instances... {{(pid=117723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:04:06.946176 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-bd0c61c1-68b4-4033-b5a5-32845b92e6ae tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] [instance: c390424a-1a68-4b4f-abea-917428ba36e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='16351c96-cb02-4711-99d5-fd4d80e8a846',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:04:07.054390 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-bd0c61c1-68b4-4033-b5a5-32845b92e6ae tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.375468 May 26 18:04:07.057534 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 168/359] 10.222.0.69 () {60 vars in 1146 bytes} [Thu May 26 18:04:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1379 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 18:04:07.074317 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-4572cb35-a17d-4881-8087-e0a04b13bde8 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:07.079643 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-4572cb35-a17d-4881-8087-e0a04b13bde8 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:07.091511 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4572cb35-a17d-4881-8087-e0a04b13bde8 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:07.092158 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4572cb35-a17d-4881-8087-e0a04b13bde8 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:07.092976 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4572cb35-a17d-4881-8087-e0a04b13bde8 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:07.093382 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4572cb35-a17d-4881-8087-e0a04b13bde8 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:07.363374 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-411c18f4-6e22-4f65-b6b2-dbe85bd3abae tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Action: 'create', calling method: .version_select at 0x7f3ab8d1c8b0>, body: {"keypair": {"name": "tempest-TestShelveInstance-631169157", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLtEpQLXshVU4QmpJQaZniUvNoMACm/0iPYWXQDWONn/RefpXrWvAxmmIrjmFQNRqWSK3zI0AJ4jGHcJ+hBu1/c9C4MiwppREl8GGjmAVQwjHK0xcBtodZA2xhSnSoCM9w=="}} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:04:07.399837 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.quota [None req-411c18f4-6e22-4f65-b6b2-dbe85bd3abae tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Getting quotas for project fce9015638524279b09969d5aacda2ba. Resources: {'key_pairs'} {{(pid=117722) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:04:07.406574 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.quota [None req-411c18f4-6e22-4f65-b6b2-dbe85bd3abae tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Getting quotas for user 0c8a0ec84d3c471f9e6baa548f0d045a and project fce9015638524279b09969d5aacda2ba. Resources: {'key_pairs'} {{(pid=117722) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:04:07.422844 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:04:07.490008 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-411c18f4-6e22-4f65-b6b2-dbe85bd3abae tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.542262 May 26 18:04:07.490887 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 192/360] 10.222.0.69 () {60 vars in 1158 bytes} [Thu May 26 18:04:06 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:04:07.534478 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-b40246fb-e515-46a5-8ff5-7ab123299281 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:07.534997 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-b40246fb-e515-46a5-8ff5-7ab123299281 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:07.555074 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b40246fb-e515-46a5-8ff5-7ab123299281 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:07.555602 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b40246fb-e515-46a5-8ff5-7ab123299281 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:07.556975 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b40246fb-e515-46a5-8ff5-7ab123299281 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:07.558637 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b40246fb-e515-46a5-8ff5-7ab123299281 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:07.619062 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-b40246fb-e515-46a5-8ff5-7ab123299281 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7/ips" status: 200 len: 149 microversion: 2.1 time: 0.127046 May 26 18:04:07.644133 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 193/361] 10.222.0.69 () {58 vars in 1247 bytes} [Thu May 26 18:04:07 2022] GET /compute/v2.1/servers/fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7/ips => generated 149 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:04:07.658820 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-a4d869e3-7d39-4e00-b30e-f7682f2fd0aa tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:07.660946 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-a4d869e3-7d39-4e00-b30e-f7682f2fd0aa tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] [instance: c390424a-1a68-4b4f-abea-917428ba36e5] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:07.674399 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-4572cb35-a17d-4881-8087-e0a04b13bde8 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:07.691551 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-4572cb35-a17d-4881-8087-e0a04b13bde8 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1721 microversion: 2.1 time: 0.616025 May 26 18:04:07.704378 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 169/362] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:07 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1721 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:07.713516 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-84eeb4c6-3af7-4818-85bf-2a40da289249 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:07.718856 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-84eeb4c6-3af7-4818-85bf-2a40da289249 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:07.739807 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-84eeb4c6-3af7-4818-85bf-2a40da289249 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:07.743545 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-84eeb4c6-3af7-4818-85bf-2a40da289249 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:07.747056 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-84eeb4c6-3af7-4818-85bf-2a40da289249 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:07.747536 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-84eeb4c6-3af7-4818-85bf-2a40da289249 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:07.860649 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-a4d869e3-7d39-4e00-b30e-f7682f2fd0aa tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b8f37c287341848d8d3b4d5f62873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fdf6152e6874f78825e5eddb7f14158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:07.878081 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-a4d869e3-7d39-4e00-b30e-f7682f2fd0aa tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] 10.222.0.69 "GET /compute/v2.1/servers/c390424a-1a68-4b4f-abea-917428ba36e5" status: 200 len: 1218 microversion: 2.1 time: 0.231101 May 26 18:04:07.881349 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 194/363] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:07 2022] GET /compute/v2.1/servers/c390424a-1a68-4b4f-abea-917428ba36e5 => generated 1218 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:07.896197 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-0f91306f-f2cb-4e9e-bc50-91a465c35ab4 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:07.898327 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-0f91306f-f2cb-4e9e-bc50-91a465c35ab4 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 704b23df-a1e8-425f-a6bf-4805b1356866] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:07.918033 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0f91306f-f2cb-4e9e-bc50-91a465c35ab4 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:07.918791 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0f91306f-f2cb-4e9e-bc50-91a465c35ab4 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:07.930035 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0f91306f-f2cb-4e9e-bc50-91a465c35ab4 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:07.931859 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0f91306f-f2cb-4e9e-bc50-91a465c35ab4 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:08.336917 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-84eeb4c6-3af7-4818-85bf-2a40da289249 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:08.360314 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-84eeb4c6-3af7-4818-85bf-2a40da289249 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:08.366358 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-84eeb4c6-3af7-4818-85bf-2a40da289249 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:08.370494 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-84eeb4c6-3af7-4818-85bf-2a40da289249 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1739 microversion: 2.20 time: 0.665672 May 26 18:04:08.374125 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 170/364] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:04:07 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1739 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:08.409314 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-0f91306f-f2cb-4e9e-bc50-91a465c35ab4 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:08.429352 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-0f91306f-f2cb-4e9e-bc50-91a465c35ab4 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866" status: 200 len: 1370 microversion: 2.1 time: 0.543846 May 26 18:04:08.429945 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 195/365] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:07 2022] GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866 => generated 1370 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:08.712534 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-2bda13f7-5252-4a06-92bd-cf9b1473dbb2 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:08.713157 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-2bda13f7-5252-4a06-92bd-cf9b1473dbb2 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:08.725028 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2bda13f7-5252-4a06-92bd-cf9b1473dbb2 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:08.728048 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2bda13f7-5252-4a06-92bd-cf9b1473dbb2 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:08.732928 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2bda13f7-5252-4a06-92bd-cf9b1473dbb2 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:08.735954 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2bda13f7-5252-4a06-92bd-cf9b1473dbb2 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:08.899141 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-48ff6f95-b679-4986-86a4-741a99e2bd70 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:08.900678 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-48ff6f95-b679-4986-86a4-741a99e2bd70 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] [instance: c390424a-1a68-4b4f-abea-917428ba36e5] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:08.916958 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-48ff6f95-b679-4986-86a4-741a99e2bd70 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:08.920173 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-48ff6f95-b679-4986-86a4-741a99e2bd70 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:08.925289 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-48ff6f95-b679-4986-86a4-741a99e2bd70 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:08.926469 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-48ff6f95-b679-4986-86a4-741a99e2bd70 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:09.185983 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-48ff6f95-b679-4986-86a4-741a99e2bd70 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b8f37c287341848d8d3b4d5f62873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fdf6152e6874f78825e5eddb7f14158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:09.205747 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-48ff6f95-b679-4986-86a4-741a99e2bd70 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] 10.222.0.69 "GET /compute/v2.1/servers/c390424a-1a68-4b4f-abea-917428ba36e5" status: 200 len: 1270 microversion: 2.1 time: 0.309221 May 26 18:04:09.217960 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 196/366] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:08 2022] GET /compute/v2.1/servers/c390424a-1a68-4b4f-abea-917428ba36e5 => generated 1270 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:04:09.391719 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-ad45f3a0-a033-4387-9a2e-4753d86787ed tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:09.392573 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-ad45f3a0-a033-4387-9a2e-4753d86787ed tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:09.412163 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ad45f3a0-a033-4387-9a2e-4753d86787ed tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:09.416347 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ad45f3a0-a033-4387-9a2e-4753d86787ed tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:09.417258 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ad45f3a0-a033-4387-9a2e-4753d86787ed tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:09.419647 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ad45f3a0-a033-4387-9a2e-4753d86787ed tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:09.759064 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-ad45f3a0-a033-4387-9a2e-4753d86787ed tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:09.781568 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-ad45f3a0-a033-4387-9a2e-4753d86787ed tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:09.783113 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-ad45f3a0-a033-4387-9a2e-4753d86787ed tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:09.789611 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-ad45f3a0-a033-4387-9a2e-4753d86787ed tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1739 microversion: 2.20 time: 0.397410 May 26 18:04:09.807882 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 197/367] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:04:09 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1739 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:09.823804 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-cd77a0b0-cd9a-4fb3-89a0-047323d8fd36 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:09.823804 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-cd77a0b0-cd9a-4fb3-89a0-047323d8fd36 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 704b23df-a1e8-425f-a6bf-4805b1356866] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:09.842418 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-cd77a0b0-cd9a-4fb3-89a0-047323d8fd36 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:09.846778 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-cd77a0b0-cd9a-4fb3-89a0-047323d8fd36 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:09.847636 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-cd77a0b0-cd9a-4fb3-89a0-047323d8fd36 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:09.848106 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-cd77a0b0-cd9a-4fb3-89a0-047323d8fd36 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:10.000131 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-2bda13f7-5252-4a06-92bd-cf9b1473dbb2 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:10.011919 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-2bda13f7-5252-4a06-92bd-cf9b1473dbb2 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1721 microversion: 2.1 time: 1.303670 May 26 18:04:10.036580 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 171/368] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:08 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1721 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:10.042844 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-86153045-f6f9-4bc9-9feb-6ae00590d05c tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4a5f9e32-e491-4a4a-afcf-a38e87c2c87a"}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:04:10.044481 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-86153045-f6f9-4bc9-9feb-6ae00590d05c tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:10.062889 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-86153045-f6f9-4bc9-9feb-6ae00590d05c tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:10.064437 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-86153045-f6f9-4bc9-9feb-6ae00590d05c tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:10.067981 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-86153045-f6f9-4bc9-9feb-6ae00590d05c tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:10.069635 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-86153045-f6f9-4bc9-9feb-6ae00590d05c tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:10.291627 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-cd77a0b0-cd9a-4fb3-89a0-047323d8fd36 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:10.300513 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-cd77a0b0-cd9a-4fb3-89a0-047323d8fd36 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866" status: 200 len: 1370 microversion: 2.1 time: 0.491394 May 26 18:04:10.311078 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 198/369] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:09 2022] GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866 => generated 1370 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:10.317218 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-8138f52b-1314-46f6-9c7f-1a1bfa1ca98d tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:10.319452 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-8138f52b-1314-46f6-9c7f-1a1bfa1ca98d tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] [instance: c390424a-1a68-4b4f-abea-917428ba36e5] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:10.333684 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-8138f52b-1314-46f6-9c7f-1a1bfa1ca98d tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:10.334398 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-8138f52b-1314-46f6-9c7f-1a1bfa1ca98d tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:10.335357 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-8138f52b-1314-46f6-9c7f-1a1bfa1ca98d tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:10.335960 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-8138f52b-1314-46f6-9c7f-1a1bfa1ca98d tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:10.471559 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-8138f52b-1314-46f6-9c7f-1a1bfa1ca98d tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b8f37c287341848d8d3b4d5f62873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fdf6152e6874f78825e5eddb7f14158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:10.481113 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-8138f52b-1314-46f6-9c7f-1a1bfa1ca98d tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] 10.222.0.69 "GET /compute/v2.1/servers/c390424a-1a68-4b4f-abea-917428ba36e5" status: 200 len: 1276 microversion: 2.1 time: 0.168066 May 26 18:04:10.488223 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 199/370] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:10 2022] GET /compute/v2.1/servers/c390424a-1a68-4b4f-abea-917428ba36e5 => generated 1276 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:10.773332 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-86153045-f6f9-4bc9-9feb-6ae00590d05c tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "POST /compute/v2.1/servers/fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.734769 May 26 18:04:10.775533 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 172/371] 10.222.0.69 () {60 vars in 1322 bytes} [Thu May 26 18:04:10 2022] POST /compute/v2.1/servers/fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7/os-volume_attachments => generated 194 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:04:10.813857 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-c1c54e1d-3af7-4cc9-a21d-fda42c0d8668 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:10.814425 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-c1c54e1d-3af7-4cc9-a21d-fda42c0d8668 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:10.837750 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c1c54e1d-3af7-4cc9-a21d-fda42c0d8668 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:10.838215 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c1c54e1d-3af7-4cc9-a21d-fda42c0d8668 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:10.839059 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c1c54e1d-3af7-4cc9-a21d-fda42c0d8668 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:10.839499 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c1c54e1d-3af7-4cc9-a21d-fda42c0d8668 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:11.035853 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-4945b87e-8c9c-4aaf-9fe3-304fcd1922f7 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:11.037103 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-4945b87e-8c9c-4aaf-9fe3-304fcd1922f7 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:11.052866 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4945b87e-8c9c-4aaf-9fe3-304fcd1922f7 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:11.058891 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4945b87e-8c9c-4aaf-9fe3-304fcd1922f7 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:11.060129 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4945b87e-8c9c-4aaf-9fe3-304fcd1922f7 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:11.060869 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4945b87e-8c9c-4aaf-9fe3-304fcd1922f7 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:11.181074 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-c1c54e1d-3af7-4cc9-a21d-fda42c0d8668 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:11.190214 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-c1c54e1d-3af7-4cc9-a21d-fda42c0d8668 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:11.191962 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-c1c54e1d-3af7-4cc9-a21d-fda42c0d8668 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:11.193371 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-c1c54e1d-3af7-4cc9-a21d-fda42c0d8668 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1739 microversion: 2.20 time: 0.386565 May 26 18:04:11.209855 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 200/372] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:04:10 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1739 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:11.322198 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-695e0bd4-c25f-4463-94c4-546e7f5291bd tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:11.323277 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-695e0bd4-c25f-4463-94c4-546e7f5291bd tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 704b23df-a1e8-425f-a6bf-4805b1356866] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:11.338550 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-695e0bd4-c25f-4463-94c4-546e7f5291bd tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:11.339002 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-695e0bd4-c25f-4463-94c4-546e7f5291bd tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:11.339817 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-695e0bd4-c25f-4463-94c4-546e7f5291bd tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:11.340835 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-695e0bd4-c25f-4463-94c4-546e7f5291bd tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:11.647148 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-695e0bd4-c25f-4463-94c4-546e7f5291bd tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:11.657845 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-695e0bd4-c25f-4463-94c4-546e7f5291bd tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866" status: 200 len: 1370 microversion: 2.1 time: 0.342199 May 26 18:04:11.667892 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 201/373] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:11 2022] GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866 => generated 1370 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:04:11.694622 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-ba45fe7e-d090-4471-b88a-f2cb5b46155f tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:11.703095 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-ba45fe7e-d090-4471-b88a-f2cb5b46155f tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] [instance: c390424a-1a68-4b4f-abea-917428ba36e5] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:11.743668 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ba45fe7e-d090-4471-b88a-f2cb5b46155f tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:11.755555 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ba45fe7e-d090-4471-b88a-f2cb5b46155f tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:11.764713 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ba45fe7e-d090-4471-b88a-f2cb5b46155f tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:11.765407 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ba45fe7e-d090-4471-b88a-f2cb5b46155f tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:11.887880 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-ba45fe7e-d090-4471-b88a-f2cb5b46155f tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b8f37c287341848d8d3b4d5f62873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fdf6152e6874f78825e5eddb7f14158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:11.895935 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-ba45fe7e-d090-4471-b88a-f2cb5b46155f tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] 10.222.0.69 "GET /compute/v2.1/servers/c390424a-1a68-4b4f-abea-917428ba36e5" status: 200 len: 1276 microversion: 2.1 time: 0.226547 May 26 18:04:11.899163 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 202/374] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:11 2022] GET /compute/v2.1/servers/c390424a-1a68-4b4f-abea-917428ba36e5 => generated 1276 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:11.908348 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [req-336da142-b560-4f2b-a005-44a9488931a1 req-ae188224-48f8-4ecf-bebf-a61f51de032a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "704b23df-a1e8-425f-a6bf-4805b1356866", "tag": "b3168a60-01f6-45c3-989d-b7db5593ac6f"}]} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:04:11.937917 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-336da142-b560-4f2b-a005-44a9488931a1 req-ae188224-48f8-4ecf-bebf-a61f51de032a service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:11.940883 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-336da142-b560-4f2b-a005-44a9488931a1 req-ae188224-48f8-4ecf-bebf-a61f51de032a service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:11.962569 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.compute.server_external_events [req-336da142-b560-4f2b-a005-44a9488931a1 req-ae188224-48f8-4ecf-bebf-a61f51de032a service nova] Creating event network-changed:b3168a60-01f6-45c3-989d-b7db5593ac6f for instance 704b23df-a1e8-425f-a6bf-4805b1356866 on hv-cinder-83607 May 26 18:04:11.974610 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [req-336da142-b560-4f2b-a005-44a9488931a1 req-ae188224-48f8-4ecf-bebf-a61f51de032a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069789 May 26 18:04:11.977710 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 203/375] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:04:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:04:12.217574 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-0045ec21-8f8a-487e-8b6c-2a2c294a8e48 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:12.219403 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-0045ec21-8f8a-487e-8b6c-2a2c294a8e48 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:12.237338 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0045ec21-8f8a-487e-8b6c-2a2c294a8e48 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:12.248848 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0045ec21-8f8a-487e-8b6c-2a2c294a8e48 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:12.249976 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0045ec21-8f8a-487e-8b6c-2a2c294a8e48 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:12.250581 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0045ec21-8f8a-487e-8b6c-2a2c294a8e48 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:12.491809 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-4945b87e-8c9c-4aaf-9fe3-304fcd1922f7 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:12.511174 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-4945b87e-8c9c-4aaf-9fe3-304fcd1922f7 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1721 microversion: 2.1 time: 1.478784 May 26 18:04:12.513962 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 173/376] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:11 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1721 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:12.675171 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-e2d276f6-8d5e-46b5-93a7-bf8d3cf7af7d tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:12.677282 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-e2d276f6-8d5e-46b5-93a7-bf8d3cf7af7d tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 704b23df-a1e8-425f-a6bf-4805b1356866] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:12.693498 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-0045ec21-8f8a-487e-8b6c-2a2c294a8e48 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:12.719678 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_cell0:SELECT=2 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:04:12.725894 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-0045ec21-8f8a-487e-8b6c-2a2c294a8e48 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:12.728399 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-0045ec21-8f8a-487e-8b6c-2a2c294a8e48 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:12.730701 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-0045ec21-8f8a-487e-8b6c-2a2c294a8e48 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1739 microversion: 2.20 time: 0.522077 May 26 18:04:12.732094 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 204/377] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:04:12 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1739 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:12.735789 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e2d276f6-8d5e-46b5-93a7-bf8d3cf7af7d tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:12.736417 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e2d276f6-8d5e-46b5-93a7-bf8d3cf7af7d tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:12.738805 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e2d276f6-8d5e-46b5-93a7-bf8d3cf7af7d tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:12.757455 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e2d276f6-8d5e-46b5-93a7-bf8d3cf7af7d tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:12.915154 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-1817e8d2-5718-431f-aa26-161f5f615ae0 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:12.915789 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-1817e8d2-5718-431f-aa26-161f5f615ae0 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] [instance: c390424a-1a68-4b4f-abea-917428ba36e5] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:12.928142 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-1817e8d2-5718-431f-aa26-161f5f615ae0 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:12.928595 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-1817e8d2-5718-431f-aa26-161f5f615ae0 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:12.933279 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-1817e8d2-5718-431f-aa26-161f5f615ae0 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:12.933867 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-1817e8d2-5718-431f-aa26-161f5f615ae0 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:13.069272 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-1817e8d2-5718-431f-aa26-161f5f615ae0 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b8f37c287341848d8d3b4d5f62873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fdf6152e6874f78825e5eddb7f14158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:13.078597 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-1817e8d2-5718-431f-aa26-161f5f615ae0 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] 10.222.0.69 "GET /compute/v2.1/servers/c390424a-1a68-4b4f-abea-917428ba36e5" status: 200 len: 1276 microversion: 2.1 time: 0.167752 May 26 18:04:13.079383 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 205/378] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:12 2022] GET /compute/v2.1/servers/c390424a-1a68-4b4f-abea-917428ba36e5 => generated 1276 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:04:13.271788 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-e2d276f6-8d5e-46b5-93a7-bf8d3cf7af7d tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:13.302837 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-e2d276f6-8d5e-46b5-93a7-bf8d3cf7af7d tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866" status: 200 len: 1370 microversion: 2.1 time: 0.631393 May 26 18:04:13.303316 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 174/379] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:12 2022] GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866 => generated 1370 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:04:13.533513 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-e960b583-7814-4090-8f36-d56fe6f8fc5b tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:13.534403 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-e960b583-7814-4090-8f36-d56fe6f8fc5b tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:13.550792 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e960b583-7814-4090-8f36-d56fe6f8fc5b tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:13.551435 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e960b583-7814-4090-8f36-d56fe6f8fc5b tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:13.552773 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e960b583-7814-4090-8f36-d56fe6f8fc5b tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:13.554269 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e960b583-7814-4090-8f36-d56fe6f8fc5b tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:13.767954 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-f1064e33-8926-476d-abc0-6689d4f1dc24 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:13.769340 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-f1064e33-8926-476d-abc0-6689d4f1dc24 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:13.787762 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f1064e33-8926-476d-abc0-6689d4f1dc24 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:13.789161 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f1064e33-8926-476d-abc0-6689d4f1dc24 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:13.792743 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f1064e33-8926-476d-abc0-6689d4f1dc24 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:13.793488 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f1064e33-8926-476d-abc0-6689d4f1dc24 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:14.001579 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-e960b583-7814-4090-8f36-d56fe6f8fc5b tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:14.013563 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-e960b583-7814-4090-8f36-d56fe6f8fc5b tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1721 microversion: 2.1 time: 0.485924 May 26 18:04:14.026987 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 206/380] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:13 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1721 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:14.099753 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-4bbe5e79-3f8e-4d43-9691-56d0749cc3ca tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:14.101741 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-4bbe5e79-3f8e-4d43-9691-56d0749cc3ca tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] [instance: c390424a-1a68-4b4f-abea-917428ba36e5] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:14.121680 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-4bbe5e79-3f8e-4d43-9691-56d0749cc3ca tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:14.123439 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-4bbe5e79-3f8e-4d43-9691-56d0749cc3ca tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:14.125485 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-4bbe5e79-3f8e-4d43-9691-56d0749cc3ca tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:14.127272 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-4bbe5e79-3f8e-4d43-9691-56d0749cc3ca tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:14.384133 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-f1064e33-8926-476d-abc0-6689d4f1dc24 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:14.393316 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-f1064e33-8926-476d-abc0-6689d4f1dc24 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:14.394843 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-f1064e33-8926-476d-abc0-6689d4f1dc24 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:14.396040 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-f1064e33-8926-476d-abc0-6689d4f1dc24 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1739 microversion: 2.20 time: 0.650622 May 26 18:04:14.396623 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 175/381] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:04:13 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1739 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:04:14.407194 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-4bbe5e79-3f8e-4d43-9691-56d0749cc3ca tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b8f37c287341848d8d3b4d5f62873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fdf6152e6874f78825e5eddb7f14158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:14.419541 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-4bbe5e79-3f8e-4d43-9691-56d0749cc3ca tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] 10.222.0.69 "GET /compute/v2.1/servers/c390424a-1a68-4b4f-abea-917428ba36e5" status: 200 len: 1318 microversion: 2.1 time: 0.324949 May 26 18:04:14.420846 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 207/382] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:14 2022] GET /compute/v2.1/servers/c390424a-1a68-4b4f-abea-917428ba36e5 => generated 1318 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:14.424451 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-1be7fbe3-a47c-44a8-a525-ca7bb7e6bf8e tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:14.425460 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-1be7fbe3-a47c-44a8-a525-ca7bb7e6bf8e tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 704b23df-a1e8-425f-a6bf-4805b1356866] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:14.433488 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1be7fbe3-a47c-44a8-a525-ca7bb7e6bf8e tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:14.434384 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1be7fbe3-a47c-44a8-a525-ca7bb7e6bf8e tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:14.435426 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1be7fbe3-a47c-44a8-a525-ca7bb7e6bf8e tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:14.436126 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1be7fbe3-a47c-44a8-a525-ca7bb7e6bf8e tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:14.735842 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-1be7fbe3-a47c-44a8-a525-ca7bb7e6bf8e tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:14.749760 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-1be7fbe3-a47c-44a8-a525-ca7bb7e6bf8e tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866" status: 200 len: 1370 microversion: 2.1 time: 0.348538 May 26 18:04:14.750405 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 176/383] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:14 2022] GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866 => generated 1370 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:15.011036 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [req-be2b78cf-cc8c-4076-9092-e01e16e766ac req-56b8ef20-dec9-4e92-b006-5aa352aac2f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c390424a-1a68-4b4f-abea-917428ba36e5", "tag": "b554fe83-95b4-4b42-aeea-6e2f977bb086"}]} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:04:15.025758 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-be2b78cf-cc8c-4076-9092-e01e16e766ac req-56b8ef20-dec9-4e92-b006-5aa352aac2f3 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:15.036177 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-658a40e1-6d20-44d7-8e33-08e9856d7452 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:15.038226 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-658a40e1-6d20-44d7-8e33-08e9856d7452 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:15.042226 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-be2b78cf-cc8c-4076-9092-e01e16e766ac req-56b8ef20-dec9-4e92-b006-5aa352aac2f3 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:15.049594 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-658a40e1-6d20-44d7-8e33-08e9856d7452 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:15.049785 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_cell1:SELECT=100 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:04:15.050403 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-658a40e1-6d20-44d7-8e33-08e9856d7452 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:15.051415 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-658a40e1-6d20-44d7-8e33-08e9856d7452 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:15.052114 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-658a40e1-6d20-44d7-8e33-08e9856d7452 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:15.059711 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.compute.server_external_events [req-be2b78cf-cc8c-4076-9092-e01e16e766ac req-56b8ef20-dec9-4e92-b006-5aa352aac2f3 service nova] Creating event network-changed:b554fe83-95b4-4b42-aeea-6e2f977bb086 for instance c390424a-1a68-4b4f-abea-917428ba36e5 on hv-cinder-83607 May 26 18:04:15.065896 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [req-be2b78cf-cc8c-4076-9092-e01e16e766ac req-56b8ef20-dec9-4e92-b006-5aa352aac2f3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058290 May 26 18:04:15.066519 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 208/384] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:04:15.202527 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-658a40e1-6d20-44d7-8e33-08e9856d7452 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:15.210575 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-658a40e1-6d20-44d7-8e33-08e9856d7452 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1721 microversion: 2.1 time: 0.183721 May 26 18:04:15.211150 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 177/385] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:15 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1721 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:15.415068 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-0d636b60-0abd-47c8-94f1-d64b551884e4 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:15.415783 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-0d636b60-0abd-47c8-94f1-d64b551884e4 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:15.423230 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0d636b60-0abd-47c8-94f1-d64b551884e4 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:15.423680 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0d636b60-0abd-47c8-94f1-d64b551884e4 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:15.424496 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0d636b60-0abd-47c8-94f1-d64b551884e4 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:15.424933 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0d636b60-0abd-47c8-94f1-d64b551884e4 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:15.436413 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-d5fc7f69-4a7b-4e7f-8f3d-8d392f5387b5 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:15.437032 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-d5fc7f69-4a7b-4e7f-8f3d-8d392f5387b5 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] [instance: c390424a-1a68-4b4f-abea-917428ba36e5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:15.443212 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d5fc7f69-4a7b-4e7f-8f3d-8d392f5387b5 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:15.443662 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d5fc7f69-4a7b-4e7f-8f3d-8d392f5387b5 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:15.444467 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d5fc7f69-4a7b-4e7f-8f3d-8d392f5387b5 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:15.445060 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d5fc7f69-4a7b-4e7f-8f3d-8d392f5387b5 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:15.587558 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-d5fc7f69-4a7b-4e7f-8f3d-8d392f5387b5 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b8f37c287341848d8d3b4d5f62873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fdf6152e6874f78825e5eddb7f14158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:15.590632 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-0d636b60-0abd-47c8-94f1-d64b551884e4 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:15.608978 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-d5fc7f69-4a7b-4e7f-8f3d-8d392f5387b5 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] 10.222.0.69 "GET /compute/v2.1/servers/c390424a-1a68-4b4f-abea-917428ba36e5" status: 200 len: 1318 microversion: 2.1 time: 0.176279 May 26 18:04:15.609261 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-0d636b60-0abd-47c8-94f1-d64b551884e4 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:15.610264 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 178/386] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:15 2022] GET /compute/v2.1/servers/c390424a-1a68-4b4f-abea-917428ba36e5 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:04:15.614757 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-0d636b60-0abd-47c8-94f1-d64b551884e4 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:15.618086 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-0d636b60-0abd-47c8-94f1-d64b551884e4 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1739 microversion: 2.20 time: 0.206947 May 26 18:04:15.630275 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 209/387] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:04:15 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1739 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:15.773160 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-efd98d46-d4d3-41a4-89c8-506c9d0b52b7 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:15.773765 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-efd98d46-d4d3-41a4-89c8-506c9d0b52b7 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 704b23df-a1e8-425f-a6bf-4805b1356866] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:15.782856 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-efd98d46-d4d3-41a4-89c8-506c9d0b52b7 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:15.783339 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-efd98d46-d4d3-41a4-89c8-506c9d0b52b7 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:15.784180 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-efd98d46-d4d3-41a4-89c8-506c9d0b52b7 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:15.784615 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-efd98d46-d4d3-41a4-89c8-506c9d0b52b7 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:16.071465 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-efd98d46-d4d3-41a4-89c8-506c9d0b52b7 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:16.084271 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-efd98d46-d4d3-41a4-89c8-506c9d0b52b7 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866" status: 200 len: 1370 microversion: 2.1 time: 0.317021 May 26 18:04:16.084981 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 179/388] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:15 2022] GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866 => generated 1370 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:16.229025 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-5a84f7f7-50ea-4de8-8dbd-b88b39c56db4 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:16.230323 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-5a84f7f7-50ea-4de8-8dbd-b88b39c56db4 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:16.253833 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-5a84f7f7-50ea-4de8-8dbd-b88b39c56db4 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:16.254362 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-5a84f7f7-50ea-4de8-8dbd-b88b39c56db4 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:16.255028 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-5a84f7f7-50ea-4de8-8dbd-b88b39c56db4 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:16.255655 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-5a84f7f7-50ea-4de8-8dbd-b88b39c56db4 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:16.426425 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-5a84f7f7-50ea-4de8-8dbd-b88b39c56db4 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:16.436799 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-5a84f7f7-50ea-4de8-8dbd-b88b39c56db4 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1698 microversion: 2.1 time: 0.212145 May 26 18:04:16.437728 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 210/389] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:16 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1698 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:16.455150 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-60152888-59d3-4d17-a245-bdfa85f8ae75 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:04:16.462346 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-60152888-59d3-4d17-a245-bdfa85f8ae75 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:16.463091 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-60152888-59d3-4d17-a245-bdfa85f8ae75 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:16.533400 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-60152888-59d3-4d17-a245-bdfa85f8ae75 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Going to try to start instance {{(pid=117723) start /opt/stack/nova/nova/compute/api.py:2730}} May 26 18:04:16.583976 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-60152888-59d3-4d17-a245-bdfa85f8ae75 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "POST /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20/action" status: 202 len: 0 microversion: 2.1 time: 0.132745 May 26 18:04:16.584934 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 180/390] 10.222.0.69 () {60 vars in 1277 bytes} [Thu May 26 18:04:16 2022] POST /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:04:16.593761 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-a836f87e-30a9-4293-8aa9-06eb5caa5ee1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:16.594372 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-a836f87e-30a9-4293-8aa9-06eb5caa5ee1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:16.600723 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-a836f87e-30a9-4293-8aa9-06eb5caa5ee1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:16.601191 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-a836f87e-30a9-4293-8aa9-06eb5caa5ee1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:16.602080 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-a836f87e-30a9-4293-8aa9-06eb5caa5ee1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:16.602519 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-a836f87e-30a9-4293-8aa9-06eb5caa5ee1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:16.639665 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-a1f57bed-5a45-470e-a613-7ba143281eb4 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:16.640480 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-a1f57bed-5a45-470e-a613-7ba143281eb4 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] [instance: c390424a-1a68-4b4f-abea-917428ba36e5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:16.647445 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a1f57bed-5a45-470e-a613-7ba143281eb4 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:16.647939 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a1f57bed-5a45-470e-a613-7ba143281eb4 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:16.649065 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a1f57bed-5a45-470e-a613-7ba143281eb4 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:16.649507 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a1f57bed-5a45-470e-a613-7ba143281eb4 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:16.802220 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-a836f87e-30a9-4293-8aa9-06eb5caa5ee1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:16.812195 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-a836f87e-30a9-4293-8aa9-06eb5caa5ee1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1707 microversion: 2.1 time: 0.223184 May 26 18:04:16.812826 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 211/391] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:16 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1707 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:04:16.817654 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-0fe0eb76-e9d9-4562-91c0-16db06ea02e3 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:16.818519 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-0fe0eb76-e9d9-4562-91c0-16db06ea02e3 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:16.829519 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0fe0eb76-e9d9-4562-91c0-16db06ea02e3 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:16.830376 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0fe0eb76-e9d9-4562-91c0-16db06ea02e3 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:16.831150 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0fe0eb76-e9d9-4562-91c0-16db06ea02e3 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:16.831693 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0fe0eb76-e9d9-4562-91c0-16db06ea02e3 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:16.861132 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell0:SELECT=2 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:04:16.925679 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell0:SELECT=8 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:04:16.975892 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-0fe0eb76-e9d9-4562-91c0-16db06ea02e3 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:16.983950 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-0fe0eb76-e9d9-4562-91c0-16db06ea02e3 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:16.985526 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-0fe0eb76-e9d9-4562-91c0-16db06ea02e3 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:16.986715 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-0fe0eb76-e9d9-4562-91c0-16db06ea02e3 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1721 microversion: 2.20 time: 0.172892 May 26 18:04:16.987411 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 212/392] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:04:16 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:16.987754 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-a1f57bed-5a45-470e-a613-7ba143281eb4 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b8f37c287341848d8d3b4d5f62873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fdf6152e6874f78825e5eddb7f14158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:16.995473 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-a1f57bed-5a45-470e-a613-7ba143281eb4 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] 10.222.0.69 "GET /compute/v2.1/servers/c390424a-1a68-4b4f-abea-917428ba36e5" status: 200 len: 1318 microversion: 2.1 time: 0.361267 May 26 18:04:16.996654 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 181/393] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:16 2022] GET /compute/v2.1/servers/c390424a-1a68-4b4f-abea-917428ba36e5 => generated 1318 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:04:17.102344 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-1d91ae48-c5b8-4f1b-a03b-8b82d4bcab43 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:17.103209 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-1d91ae48-c5b8-4f1b-a03b-8b82d4bcab43 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 704b23df-a1e8-425f-a6bf-4805b1356866] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:17.114905 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-1d91ae48-c5b8-4f1b-a03b-8b82d4bcab43 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:17.115359 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-1d91ae48-c5b8-4f1b-a03b-8b82d4bcab43 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:17.116194 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-1d91ae48-c5b8-4f1b-a03b-8b82d4bcab43 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:17.116649 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-1d91ae48-c5b8-4f1b-a03b-8b82d4bcab43 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:17.269594 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-1d91ae48-c5b8-4f1b-a03b-8b82d4bcab43 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:17.282829 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-1d91ae48-c5b8-4f1b-a03b-8b82d4bcab43 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866" status: 200 len: 1370 microversion: 2.1 time: 0.184302 May 26 18:04:17.283506 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 213/394] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:17 2022] GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866 => generated 1370 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:17.831589 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-f9d827aa-f4ca-465e-850f-6ac0a732b761 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:17.832855 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-f9d827aa-f4ca-465e-850f-6ac0a732b761 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:17.843296 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f9d827aa-f4ca-465e-850f-6ac0a732b761 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:17.844467 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f9d827aa-f4ca-465e-850f-6ac0a732b761 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:17.845434 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f9d827aa-f4ca-465e-850f-6ac0a732b761 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:17.846276 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f9d827aa-f4ca-465e-850f-6ac0a732b761 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:18.006221 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-59af4164-dd18-4672-a695-5163dec6359c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:18.008732 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-59af4164-dd18-4672-a695-5163dec6359c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:18.010912 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_cell0:SELECT=16 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:04:18.017464 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-59af4164-dd18-4672-a695-5163dec6359c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:18.018014 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-59af4164-dd18-4672-a695-5163dec6359c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:18.019280 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-59af4164-dd18-4672-a695-5163dec6359c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:18.020236 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-59af4164-dd18-4672-a695-5163dec6359c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:18.209653 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-59af4164-dd18-4672-a695-5163dec6359c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:18.219852 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-59af4164-dd18-4672-a695-5163dec6359c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:18.221944 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-59af4164-dd18-4672-a695-5163dec6359c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:18.224560 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-59af4164-dd18-4672-a695-5163dec6359c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1721 microversion: 2.20 time: 0.221272 May 26 18:04:18.225168 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 214/395] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:04:18 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1721 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:04:18.242792 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-c495fd31-65d4-4f71-950e-66a5432042a4 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:18.243420 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-c495fd31-65d4-4f71-950e-66a5432042a4 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] [instance: c390424a-1a68-4b4f-abea-917428ba36e5] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:18.251223 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c495fd31-65d4-4f71-950e-66a5432042a4 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:18.251973 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c495fd31-65d4-4f71-950e-66a5432042a4 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:18.253393 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c495fd31-65d4-4f71-950e-66a5432042a4 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:18.254007 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c495fd31-65d4-4f71-950e-66a5432042a4 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:18.285446 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-f9d827aa-f4ca-465e-850f-6ac0a732b761 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:18.304175 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-f9d827aa-f4ca-465e-850f-6ac0a732b761 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1707 microversion: 2.1 time: 0.477000 May 26 18:04:18.305226 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 182/396] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:17 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1707 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:18.314092 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-ef7dd3dd-7818-4c06-bfa8-b5b45cd5102c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:18.317249 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-ef7dd3dd-7818-4c06-bfa8-b5b45cd5102c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 704b23df-a1e8-425f-a6bf-4805b1356866] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:18.334873 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ef7dd3dd-7818-4c06-bfa8-b5b45cd5102c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:18.337060 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ef7dd3dd-7818-4c06-bfa8-b5b45cd5102c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:18.344186 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ef7dd3dd-7818-4c06-bfa8-b5b45cd5102c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:18.345791 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ef7dd3dd-7818-4c06-bfa8-b5b45cd5102c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:18.387956 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:04:18.435429 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-c495fd31-65d4-4f71-950e-66a5432042a4 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b8f37c287341848d8d3b4d5f62873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fdf6152e6874f78825e5eddb7f14158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:18.447223 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-c495fd31-65d4-4f71-950e-66a5432042a4 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] 10.222.0.69 "GET /compute/v2.1/servers/c390424a-1a68-4b4f-abea-917428ba36e5" status: 200 len: 1318 microversion: 2.1 time: 0.220737 May 26 18:04:18.447889 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 215/397] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:18 2022] GET /compute/v2.1/servers/c390424a-1a68-4b4f-abea-917428ba36e5 => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:18.712486 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-02cf5d46-94d6-4754-b23a-ead21969dfa4 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Action: 'create', calling method: .version_select at 0x7f3ab8d1cca0>, body: {"keypair": {"name": "tempest-keypair-64943514", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwXh+TS7F+5uiBgY9up4IzDn/nh/MsDzjybvhPMs16SF0Kagp5wWJOZhAXz7hC2eN/RNDzGp54QcZ8tlJX1RLJn/rRDxdjJGuwxz2B6Q5BuShMvlCB4eX8+ICj4xkfPng=="}} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:04:18.716942 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-ef7dd3dd-7818-4c06-bfa8-b5b45cd5102c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:18.725054 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-ef7dd3dd-7818-4c06-bfa8-b5b45cd5102c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866" status: 200 len: 1370 microversion: 2.1 time: 0.417554 May 26 18:04:18.725990 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 183/398] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:18 2022] GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866 => generated 1370 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:18.728838 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.quota [None req-02cf5d46-94d6-4754-b23a-ead21969dfa4 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Getting quotas for project 8920d2de9dc34386bb0e770f5b51b702. Resources: {'key_pairs'} {{(pid=117722) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:04:18.733046 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.quota [None req-02cf5d46-94d6-4754-b23a-ead21969dfa4 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Getting quotas for user 2691e1dc96e942b5ba4c726b72a835e9 and project 8920d2de9dc34386bb0e770f5b51b702. Resources: {'key_pairs'} {{(pid=117722) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:04:18.764531 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-02cf5d46-94d6-4754-b23a-ead21969dfa4 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.065141 May 26 18:04:18.765565 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 216/399] 10.222.0.69 () {60 vars in 1158 bytes} [Thu May 26 18:04:18 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:04:19.246293 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-1156bbf1-5b09-4d1e-85b5-8b4c47efab8b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:19.246911 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-1156bbf1-5b09-4d1e-85b5-8b4c47efab8b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:19.254476 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1156bbf1-5b09-4d1e-85b5-8b4c47efab8b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:19.255506 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1156bbf1-5b09-4d1e-85b5-8b4c47efab8b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:19.256531 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1156bbf1-5b09-4d1e-85b5-8b4c47efab8b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:19.256975 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1156bbf1-5b09-4d1e-85b5-8b4c47efab8b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:19.323043 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-bda0fad7-1288-4a8d-930d-44e7925c7df5 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:19.324756 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-bda0fad7-1288-4a8d-930d-44e7925c7df5 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:19.339787 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-bda0fad7-1288-4a8d-930d-44e7925c7df5 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:19.340648 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-bda0fad7-1288-4a8d-930d-44e7925c7df5 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:19.341555 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-bda0fad7-1288-4a8d-930d-44e7925c7df5 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:19.342063 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-bda0fad7-1288-4a8d-930d-44e7925c7df5 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:19.481118 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-1156bbf1-5b09-4d1e-85b5-8b4c47efab8b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:19.487222 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-bda0fad7-1288-4a8d-930d-44e7925c7df5 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:19.491249 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-1156bbf1-5b09-4d1e-85b5-8b4c47efab8b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:19.492821 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-1156bbf1-5b09-4d1e-85b5-8b4c47efab8b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:19.494040 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-1156bbf1-5b09-4d1e-85b5-8b4c47efab8b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1721 microversion: 2.20 time: 0.252355 May 26 18:04:19.494608 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 184/400] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:04:19 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1721 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:19.495659 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-bda0fad7-1288-4a8d-930d-44e7925c7df5 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1707 microversion: 2.1 time: 0.177359 May 26 18:04:19.505966 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-09fe7af8-420d-4cdf-a92f-9a1bab9b083b tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:19.505966 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-09fe7af8-420d-4cdf-a92f-9a1bab9b083b tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] [instance: c390424a-1a68-4b4f-abea-917428ba36e5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:19.506669 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 217/401] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:19 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1707 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:04:19.508087 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-09fe7af8-420d-4cdf-a92f-9a1bab9b083b tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:19.508550 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-09fe7af8-420d-4cdf-a92f-9a1bab9b083b tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:19.509331 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-09fe7af8-420d-4cdf-a92f-9a1bab9b083b tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:19.509770 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-09fe7af8-420d-4cdf-a92f-9a1bab9b083b tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:19.742854 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-e3d8fa78-66e6-4259-8b49-b95f2b2cce16 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:19.743419 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-e3d8fa78-66e6-4259-8b49-b95f2b2cce16 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 704b23df-a1e8-425f-a6bf-4805b1356866] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:19.752401 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e3d8fa78-66e6-4259-8b49-b95f2b2cce16 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:19.752856 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e3d8fa78-66e6-4259-8b49-b95f2b2cce16 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:19.753645 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e3d8fa78-66e6-4259-8b49-b95f2b2cce16 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:19.754088 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e3d8fa78-66e6-4259-8b49-b95f2b2cce16 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:19.906425 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-e3d8fa78-66e6-4259-8b49-b95f2b2cce16 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:19.914962 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-e3d8fa78-66e6-4259-8b49-b95f2b2cce16 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866" status: 200 len: 1370 microversion: 2.1 time: 0.176284 May 26 18:04:19.915881 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 218/402] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:19 2022] GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866 => generated 1370 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:04:20.164918 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-09fe7af8-420d-4cdf-a92f-9a1bab9b083b tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b8f37c287341848d8d3b4d5f62873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fdf6152e6874f78825e5eddb7f14158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:20.174435 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-09fe7af8-420d-4cdf-a92f-9a1bab9b083b tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] 10.222.0.69 "GET /compute/v2.1/servers/c390424a-1a68-4b4f-abea-917428ba36e5" status: 200 len: 1318 microversion: 2.1 time: 0.678627 May 26 18:04:20.175924 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 185/403] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:19 2022] GET /compute/v2.1/servers/c390424a-1a68-4b4f-abea-917428ba36e5 => generated 1318 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:20.264268 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [req-5a4b0c90-5468-4bf9-8c6a-350d4c52efc2 req-e511d83a-9b48-4d7d-b01b-3b573ad08e3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "704b23df-a1e8-425f-a6bf-4805b1356866", "name": "network-vif-plugged", "status": "completed", "tag": "b3168a60-01f6-45c3-989d-b7db5593ac6f"}]} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:04:20.276799 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-5a4b0c90-5468-4bf9-8c6a-350d4c52efc2 req-e511d83a-9b48-4d7d-b01b-3b573ad08e3a service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:20.277867 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-5a4b0c90-5468-4bf9-8c6a-350d4c52efc2 req-e511d83a-9b48-4d7d-b01b-3b573ad08e3a service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:20.296600 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.compute.server_external_events [req-5a4b0c90-5468-4bf9-8c6a-350d4c52efc2 req-e511d83a-9b48-4d7d-b01b-3b573ad08e3a service nova] Creating event network-vif-plugged:b3168a60-01f6-45c3-989d-b7db5593ac6f for instance 704b23df-a1e8-425f-a6bf-4805b1356866 on hv-cinder-83607 May 26 18:04:20.302993 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [req-5a4b0c90-5468-4bf9-8c6a-350d4c52efc2 req-e511d83a-9b48-4d7d-b01b-3b573ad08e3a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043924 May 26 18:04:20.304156 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 219/404] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:04:20.514323 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-1c69c49c-ff7e-41ef-a785-edae1011df8a tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:20.514897 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-1c69c49c-ff7e-41ef-a785-edae1011df8a tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:20.517266 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-022ad485-2a94-4e9a-bf2f-2411c4bd5185 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:20.518057 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-022ad485-2a94-4e9a-bf2f-2411c4bd5185 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:20.524807 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-022ad485-2a94-4e9a-bf2f-2411c4bd5185 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:20.525764 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-022ad485-2a94-4e9a-bf2f-2411c4bd5185 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:20.525939 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1c69c49c-ff7e-41ef-a785-edae1011df8a tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:20.526745 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1c69c49c-ff7e-41ef-a785-edae1011df8a tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:20.527165 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-022ad485-2a94-4e9a-bf2f-2411c4bd5185 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:20.527712 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-022ad485-2a94-4e9a-bf2f-2411c4bd5185 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:20.528629 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1c69c49c-ff7e-41ef-a785-edae1011df8a tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:20.529233 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1c69c49c-ff7e-41ef-a785-edae1011df8a tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:20.700039 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-022ad485-2a94-4e9a-bf2f-2411c4bd5185 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:20.708521 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-022ad485-2a94-4e9a-bf2f-2411c4bd5185 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1707 microversion: 2.1 time: 0.197339 May 26 18:04:20.709107 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 220/405] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:20 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1707 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:20.862800 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-1c69c49c-ff7e-41ef-a785-edae1011df8a tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:20.876337 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-1c69c49c-ff7e-41ef-a785-edae1011df8a tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:20.876337 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-1c69c49c-ff7e-41ef-a785-edae1011df8a tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:20.876337 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-1c69c49c-ff7e-41ef-a785-edae1011df8a tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1721 microversion: 2.20 time: 0.366498 May 26 18:04:20.884459 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 186/406] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:04:20 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1721 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:20.939729 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-76f2624a-4bfa-4035-89a0-173f69a477f5 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:20.940411 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-76f2624a-4bfa-4035-89a0-173f69a477f5 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 704b23df-a1e8-425f-a6bf-4805b1356866] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:20.947645 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-76f2624a-4bfa-4035-89a0-173f69a477f5 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:20.948569 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-76f2624a-4bfa-4035-89a0-173f69a477f5 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:20.949636 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-76f2624a-4bfa-4035-89a0-173f69a477f5 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:20.950483 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-76f2624a-4bfa-4035-89a0-173f69a477f5 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:21.063739 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-682cc5f4-5b3d-4081-9dad-e05a417e0414 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2097921406", "imageRef": "16351c96-cb02-4711-99d5-fd4d80e8a846", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "481c535b-a9e7-4c84-8151-52762a8d6376"}], "security_groups": [{"name": "tempest-securitygroup--1574954064"}], "key_name": "tempest-keypair-64943514", "user_data": "}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:04:21.099424 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-76f2624a-4bfa-4035-89a0-173f69a477f5 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:21.109411 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-76f2624a-4bfa-4035-89a0-173f69a477f5 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866" status: 200 len: 1370 microversion: 2.1 time: 0.180203 May 26 18:04:21.109865 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 221/407] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:20 2022] GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866 => generated 1370 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:21.176570 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.network.neutron [None req-682cc5f4-5b3d-4081-9dad-e05a417e0414 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] validate_networks() for [('481c535b-a9e7-4c84-8151-52762a8d6376', None, None, None, None, None)] {{(pid=117723) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:04:21.200866 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-e8c1a5b5-80ea-488d-b567-214709297b48 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:21.202068 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-e8c1a5b5-80ea-488d-b567-214709297b48 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] [instance: c390424a-1a68-4b4f-abea-917428ba36e5] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:21.215703 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e8c1a5b5-80ea-488d-b567-214709297b48 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:21.216903 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e8c1a5b5-80ea-488d-b567-214709297b48 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:21.218721 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e8c1a5b5-80ea-488d-b567-214709297b48 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:21.220250 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e8c1a5b5-80ea-488d-b567-214709297b48 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:21.422654 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-e8c1a5b5-80ea-488d-b567-214709297b48 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b8f37c287341848d8d3b4d5f62873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fdf6152e6874f78825e5eddb7f14158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:21.430543 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-e8c1a5b5-80ea-488d-b567-214709297b48 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] 10.222.0.69 "GET /compute/v2.1/servers/c390424a-1a68-4b4f-abea-917428ba36e5" status: 200 len: 1318 microversion: 2.1 time: 0.239666 May 26 18:04:21.431145 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 222/408] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:21 2022] GET /compute/v2.1/servers/c390424a-1a68-4b4f-abea-917428ba36e5 => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:21.727013 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-4a976690-a515-456e-9e55-82d2fc68aec2 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:21.728120 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-4a976690-a515-456e-9e55-82d2fc68aec2 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:21.736128 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-4a976690-a515-456e-9e55-82d2fc68aec2 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:21.736929 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-4a976690-a515-456e-9e55-82d2fc68aec2 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:21.737945 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-4a976690-a515-456e-9e55-82d2fc68aec2 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:21.738487 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-4a976690-a515-456e-9e55-82d2fc68aec2 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:21.753423 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-682cc5f4-5b3d-4081-9dad-e05a417e0414 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Flavor limits 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:04:21.753938 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-682cc5f4-5b3d-4081-9dad-e05a417e0414 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Image limits 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:04:21.754369 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-682cc5f4-5b3d-4081-9dad-e05a417e0414 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Flavor pref 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:04:21.754788 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-682cc5f4-5b3d-4081-9dad-e05a417e0414 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Image pref 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:04:21.755215 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-682cc5f4-5b3d-4081-9dad-e05a417e0414 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:04:21.765519 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-682cc5f4-5b3d-4081-9dad-e05a417e0414 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:21.766302 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-682cc5f4-5b3d-4081-9dad-e05a417e0414 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:21.768472 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-682cc5f4-5b3d-4081-9dad-e05a417e0414 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:21.768472 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-682cc5f4-5b3d-4081-9dad-e05a417e0414 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:21.793629 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-682cc5f4-5b3d-4081-9dad-e05a417e0414 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Getting quotas for project 8920d2de9dc34386bb0e770f5b51b702. Resources: {'instances', 'ram', 'cores'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:04:21.798045 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-682cc5f4-5b3d-4081-9dad-e05a417e0414 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Getting quotas for user 2691e1dc96e942b5ba4c726b72a835e9 and project 8920d2de9dc34386bb0e770f5b51b702. Resources: {'instances', 'ram', 'cores'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:04:21.811532 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-682cc5f4-5b3d-4081-9dad-e05a417e0414 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Going to run 1 instances... {{(pid=117723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:04:21.814078 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-682cc5f4-5b3d-4081-9dad-e05a417e0414 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 6bb99e9b-15af-408e-af01-6e08b8294058] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='16351c96-cb02-4711-99d5-fd4d80e8a846',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:04:21.878874 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-682cc5f4-5b3d-4081-9dad-e05a417e0414 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.820264 May 26 18:04:21.879700 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 187/409] 10.222.0.69 () {60 vars in 1146 bytes} [Thu May 26 18:04:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 822 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 26 18:04:21.890612 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-4a976690-a515-456e-9e55-82d2fc68aec2 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:21.896958 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-74568d05-f9b9-4510-8af5-e8111947085a tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:21.897590 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-74568d05-f9b9-4510-8af5-e8111947085a tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 6bb99e9b-15af-408e-af01-6e08b8294058] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:21.899132 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-4a976690-a515-456e-9e55-82d2fc68aec2 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1711 microversion: 2.1 time: 0.175891 May 26 18:04:21.912582 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 223/410] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:21 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1711 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:04:21.920243 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-46e003f5-69f5-40d1-8083-20d2ef366da7 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:21.920873 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-46e003f5-69f5-40d1-8083-20d2ef366da7 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:21.928098 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-46e003f5-69f5-40d1-8083-20d2ef366da7 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:21.928561 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-46e003f5-69f5-40d1-8083-20d2ef366da7 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:21.929350 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-46e003f5-69f5-40d1-8083-20d2ef366da7 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:21.929794 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-46e003f5-69f5-40d1-8083-20d2ef366da7 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:21.962500 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-74568d05-f9b9-4510-8af5-e8111947085a tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:21.970854 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-74568d05-f9b9-4510-8af5-e8111947085a tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058" status: 200 len: 1240 microversion: 2.1 time: 0.084632 May 26 18:04:21.971646 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 188/411] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:21 2022] GET /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058 => generated 1240 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:22.087671 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-46e003f5-69f5-40d1-8083-20d2ef366da7 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:22.097369 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-46e003f5-69f5-40d1-8083-20d2ef366da7 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:22.099047 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-46e003f5-69f5-40d1-8083-20d2ef366da7 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:22.100296 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-46e003f5-69f5-40d1-8083-20d2ef366da7 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1721 microversion: 2.20 time: 0.186662 May 26 18:04:22.100866 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 224/412] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:04:21 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1721 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:22.130924 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-b0d2a9fd-6d38-4da2-8925-3ab7c20846d2 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:22.131535 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-b0d2a9fd-6d38-4da2-8925-3ab7c20846d2 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 704b23df-a1e8-425f-a6bf-4805b1356866] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:22.139401 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b0d2a9fd-6d38-4da2-8925-3ab7c20846d2 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:22.139754 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b0d2a9fd-6d38-4da2-8925-3ab7c20846d2 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:22.140532 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b0d2a9fd-6d38-4da2-8925-3ab7c20846d2 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:22.140973 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b0d2a9fd-6d38-4da2-8925-3ab7c20846d2 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:22.306650 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-b0d2a9fd-6d38-4da2-8925-3ab7c20846d2 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:22.322549 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-b0d2a9fd-6d38-4da2-8925-3ab7c20846d2 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866" status: 200 len: 1370 microversion: 2.1 time: 0.195019 May 26 18:04:22.323795 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 189/413] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:22 2022] GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866 => generated 1370 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:22.335211 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [req-a5859a0f-8388-4b33-ac63-29ced63a1b3a req-819cb66f-9747-4edd-a44a-b0c28eab90f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "262a4944-6c10-4122-adce-f7780ff4e7a1", "name": "network-vif-unplugged", "status": "completed", "tag": "0450cfd2-c365-4788-a3b6-a839770208e7"}]} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:04:22.351288 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-a5859a0f-8388-4b33-ac63-29ced63a1b3a req-819cb66f-9747-4edd-a44a-b0c28eab90f3 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:22.351916 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-a5859a0f-8388-4b33-ac63-29ced63a1b3a req-819cb66f-9747-4edd-a44a-b0c28eab90f3 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:22.367578 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.compute.server_external_events [req-a5859a0f-8388-4b33-ac63-29ced63a1b3a req-819cb66f-9747-4edd-a44a-b0c28eab90f3 service nova] Creating event network-vif-unplugged:0450cfd2-c365-4788-a3b6-a839770208e7 for instance 262a4944-6c10-4122-adce-f7780ff4e7a1 on hv-cinder-83607 May 26 18:04:22.373259 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [req-a5859a0f-8388-4b33-ac63-29ced63a1b3a req-819cb66f-9747-4edd-a44a-b0c28eab90f3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042289 May 26 18:04:22.374138 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 225/414] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:04:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:04:22.446540 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-9179e1b5-714f-47f1-a9f0-262b2dc6106a tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:22.447142 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-9179e1b5-714f-47f1-a9f0-262b2dc6106a tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] [instance: c390424a-1a68-4b4f-abea-917428ba36e5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:22.453563 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9179e1b5-714f-47f1-a9f0-262b2dc6106a tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:22.454011 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9179e1b5-714f-47f1-a9f0-262b2dc6106a tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:22.454767 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9179e1b5-714f-47f1-a9f0-262b2dc6106a tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:22.455197 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9179e1b5-714f-47f1-a9f0-262b2dc6106a tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:22.591110 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-9179e1b5-714f-47f1-a9f0-262b2dc6106a tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b8f37c287341848d8d3b4d5f62873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fdf6152e6874f78825e5eddb7f14158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:22.599035 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-9179e1b5-714f-47f1-a9f0-262b2dc6106a tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] 10.222.0.69 "GET /compute/v2.1/servers/c390424a-1a68-4b4f-abea-917428ba36e5" status: 200 len: 1318 microversion: 2.1 time: 0.156225 May 26 18:04:22.599622 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 190/415] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:22 2022] GET /compute/v2.1/servers/c390424a-1a68-4b4f-abea-917428ba36e5 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:22.989117 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-ce8934d5-6695-4710-b573-cc8233c419e3 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:22.989731 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-ce8934d5-6695-4710-b573-cc8233c419e3 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 6bb99e9b-15af-408e-af01-6e08b8294058] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:22.996956 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ce8934d5-6695-4710-b573-cc8233c419e3 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:22.997408 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ce8934d5-6695-4710-b573-cc8233c419e3 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:22.998184 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ce8934d5-6695-4710-b573-cc8233c419e3 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:22.998631 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ce8934d5-6695-4710-b573-cc8233c419e3 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:23.065975 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-ce8934d5-6695-4710-b573-cc8233c419e3 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:23.073478 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-ce8934d5-6695-4710-b573-cc8233c419e3 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058" status: 200 len: 1244 microversion: 2.1 time: 0.088660 May 26 18:04:23.074400 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 226/416] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:22 2022] GET /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058 => generated 1244 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:23.118604 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-bcdb41a9-f8c2-4e24-a111-943206b70e7f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:23.119212 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-bcdb41a9-f8c2-4e24-a111-943206b70e7f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:23.125223 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-bcdb41a9-f8c2-4e24-a111-943206b70e7f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:23.125670 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-bcdb41a9-f8c2-4e24-a111-943206b70e7f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:23.126464 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-bcdb41a9-f8c2-4e24-a111-943206b70e7f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:23.126890 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-bcdb41a9-f8c2-4e24-a111-943206b70e7f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:23.262955 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-bcdb41a9-f8c2-4e24-a111-943206b70e7f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:23.270941 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-bcdb41a9-f8c2-4e24-a111-943206b70e7f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:23.272461 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-bcdb41a9-f8c2-4e24-a111-943206b70e7f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:23.273616 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-bcdb41a9-f8c2-4e24-a111-943206b70e7f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1721 microversion: 2.20 time: 0.158895 May 26 18:04:23.274178 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 191/417] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:04:23 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:23.348074 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-b82b9261-2244-4911-a9e3-5a83e47d75ab tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:23.348687 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-b82b9261-2244-4911-a9e3-5a83e47d75ab tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 704b23df-a1e8-425f-a6bf-4805b1356866] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:23.355016 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b82b9261-2244-4911-a9e3-5a83e47d75ab tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:23.355467 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b82b9261-2244-4911-a9e3-5a83e47d75ab tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:23.356269 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b82b9261-2244-4911-a9e3-5a83e47d75ab tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:23.356716 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b82b9261-2244-4911-a9e3-5a83e47d75ab tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:23.493275 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-b82b9261-2244-4911-a9e3-5a83e47d75ab tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:23.496283 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_cell1:SELECT=100 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:04:23.503023 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-b82b9261-2244-4911-a9e3-5a83e47d75ab tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866" status: 200 len: 1370 microversion: 2.1 time: 0.158718 May 26 18:04:23.503549 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 227/418] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:23 2022] GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866 => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:23.615901 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-1dbe933e-7c96-465a-8e9b-407e990fbf80 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:23.616533 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-1dbe933e-7c96-465a-8e9b-407e990fbf80 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] [instance: c390424a-1a68-4b4f-abea-917428ba36e5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:23.624046 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1dbe933e-7c96-465a-8e9b-407e990fbf80 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:23.624502 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1dbe933e-7c96-465a-8e9b-407e990fbf80 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:23.625265 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1dbe933e-7c96-465a-8e9b-407e990fbf80 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:23.625703 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1dbe933e-7c96-465a-8e9b-407e990fbf80 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:23.769342 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-1dbe933e-7c96-465a-8e9b-407e990fbf80 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b8f37c287341848d8d3b4d5f62873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fdf6152e6874f78825e5eddb7f14158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:23.777175 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-1dbe933e-7c96-465a-8e9b-407e990fbf80 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] 10.222.0.69 "GET /compute/v2.1/servers/c390424a-1a68-4b4f-abea-917428ba36e5" status: 200 len: 1318 microversion: 2.1 time: 0.165015 May 26 18:04:23.777773 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 192/419] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:23 2022] GET /compute/v2.1/servers/c390424a-1a68-4b4f-abea-917428ba36e5 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:24.093875 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-9bfa1320-624c-499b-bbcf-3121aeb9b7da tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:24.095141 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-9bfa1320-624c-499b-bbcf-3121aeb9b7da tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 6bb99e9b-15af-408e-af01-6e08b8294058] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:24.103265 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-9bfa1320-624c-499b-bbcf-3121aeb9b7da tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:24.104008 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-9bfa1320-624c-499b-bbcf-3121aeb9b7da tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:24.105315 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-9bfa1320-624c-499b-bbcf-3121aeb9b7da tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:24.105732 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-9bfa1320-624c-499b-bbcf-3121aeb9b7da tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:24.183957 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-9bfa1320-624c-499b-bbcf-3121aeb9b7da tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:24.192117 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-9bfa1320-624c-499b-bbcf-3121aeb9b7da tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058" status: 200 len: 1292 microversion: 2.1 time: 0.105101 May 26 18:04:24.192812 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 228/420] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:24 2022] GET /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058 => generated 1292 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:24.291532 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-84c1c364-65b3-4cbd-9fab-57d06b2fe5cf tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:24.292335 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-84c1c364-65b3-4cbd-9fab-57d06b2fe5cf tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:24.298629 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-84c1c364-65b3-4cbd-9fab-57d06b2fe5cf tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:24.299081 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-84c1c364-65b3-4cbd-9fab-57d06b2fe5cf tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:24.299858 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-84c1c364-65b3-4cbd-9fab-57d06b2fe5cf tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:24.300315 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-84c1c364-65b3-4cbd-9fab-57d06b2fe5cf tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:24.400983 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [req-44b11daf-04d0-4bba-98b0-e392749aed33 req-d3740cf8-6aa6-46d6-8c5e-2cf5401532b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c390424a-1a68-4b4f-abea-917428ba36e5", "name": "network-vif-plugged", "status": "completed", "tag": "b554fe83-95b4-4b42-aeea-6e2f977bb086"}]} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:04:24.413315 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-44b11daf-04d0-4bba-98b0-e392749aed33 req-d3740cf8-6aa6-46d6-8c5e-2cf5401532b2 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:24.414591 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-44b11daf-04d0-4bba-98b0-e392749aed33 req-d3740cf8-6aa6-46d6-8c5e-2cf5401532b2 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:24.426460 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.compute.server_external_events [req-44b11daf-04d0-4bba-98b0-e392749aed33 req-d3740cf8-6aa6-46d6-8c5e-2cf5401532b2 service nova] Creating event network-vif-plugged:b554fe83-95b4-4b42-aeea-6e2f977bb086 for instance c390424a-1a68-4b4f-abea-917428ba36e5 on hv-cinder-83607 May 26 18:04:24.432190 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [req-44b11daf-04d0-4bba-98b0-e392749aed33 req-d3740cf8-6aa6-46d6-8c5e-2cf5401532b2 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037452 May 26 18:04:24.432809 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 229/421] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:04:24.446944 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-84c1c364-65b3-4cbd-9fab-57d06b2fe5cf tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:24.455830 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-84c1c364-65b3-4cbd-9fab-57d06b2fe5cf tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:24.457365 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-84c1c364-65b3-4cbd-9fab-57d06b2fe5cf tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:24.458712 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-84c1c364-65b3-4cbd-9fab-57d06b2fe5cf tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1724 microversion: 2.20 time: 0.171166 May 26 18:04:24.459271 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 193/422] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:04:24 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:24.477360 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-e880e16d-e72f-4a65-98a2-b013d10e9937 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9e863701-bc56-4894-99af-f69645ce8d0e"}} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:04:24.478751 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-e880e16d-e72f-4a65-98a2-b013d10e9937 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:24.485190 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e880e16d-e72f-4a65-98a2-b013d10e9937 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:24.485638 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e880e16d-e72f-4a65-98a2-b013d10e9937 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:24.486411 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e880e16d-e72f-4a65-98a2-b013d10e9937 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:24.486850 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e880e16d-e72f-4a65-98a2-b013d10e9937 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:24.520241 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-0352aff3-d98e-4c62-8b4e-e9cdbed07315 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:24.520888 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-0352aff3-d98e-4c62-8b4e-e9cdbed07315 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 704b23df-a1e8-425f-a6bf-4805b1356866] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:24.527289 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0352aff3-d98e-4c62-8b4e-e9cdbed07315 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:24.527858 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0352aff3-d98e-4c62-8b4e-e9cdbed07315 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:24.528812 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0352aff3-d98e-4c62-8b4e-e9cdbed07315 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:24.529196 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0352aff3-d98e-4c62-8b4e-e9cdbed07315 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:24.679644 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-0352aff3-d98e-4c62-8b4e-e9cdbed07315 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:24.689185 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-0352aff3-d98e-4c62-8b4e-e9cdbed07315 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866" status: 200 len: 1565 microversion: 2.1 time: 0.172723 May 26 18:04:24.690091 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 194/423] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:24 2022] GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866 => generated 1565 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:04:24.708200 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-a4c71dc6-7bef-4bfe-bc37-e0e644a6c258 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:24.708701 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-a4c71dc6-7bef-4bfe-bc37-e0e644a6c258 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 704b23df-a1e8-425f-a6bf-4805b1356866] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:24.715343 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a4c71dc6-7bef-4bfe-bc37-e0e644a6c258 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:24.715793 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a4c71dc6-7bef-4bfe-bc37-e0e644a6c258 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:24.716608 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a4c71dc6-7bef-4bfe-bc37-e0e644a6c258 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:24.717045 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a4c71dc6-7bef-4bfe-bc37-e0e644a6c258 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:24.809043 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-a4c71dc6-7bef-4bfe-bc37-e0e644a6c258 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.104207 May 26 18:04:24.809648 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 195/424] 10.222.0.69 () {58 vars in 1274 bytes} [Thu May 26 18:04:24 2022] GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866/os-interface => generated 285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:04:24.814511 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-e97e3ee6-3e9b-4015-a86c-1f02075714d2 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:24.815141 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-e97e3ee6-3e9b-4015-a86c-1f02075714d2 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] [instance: c390424a-1a68-4b4f-abea-917428ba36e5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:24.820001 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-e880e16d-e72f-4a65-98a2-b013d10e9937 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "POST /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.346990 May 26 18:04:24.825955 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 230/425] 10.222.0.69 () {62 vars in 1363 bytes} [Thu May 26 18:04:24 2022] POST /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1/os-volume_attachments => generated 188 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 18:04:24.844176 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e97e3ee6-3e9b-4015-a86c-1f02075714d2 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:24.844888 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e97e3ee6-3e9b-4015-a86c-1f02075714d2 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:24.845892 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e97e3ee6-3e9b-4015-a86c-1f02075714d2 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:24.846567 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e97e3ee6-3e9b-4015-a86c-1f02075714d2 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:24.950709 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-94b62667-89d8-4506-8ef8-22fdfbeede12 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:04:24.951283 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-94b62667-89d8-4506-8ef8-22fdfbeede12 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:24.960806 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-94b62667-89d8-4506-8ef8-22fdfbeede12 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:24.961628 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-94b62667-89d8-4506-8ef8-22fdfbeede12 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:24.962979 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-94b62667-89d8-4506-8ef8-22fdfbeede12 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:24.964325 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-94b62667-89d8-4506-8ef8-22fdfbeede12 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:25.011102 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-e97e3ee6-3e9b-4015-a86c-1f02075714d2 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b8f37c287341848d8d3b4d5f62873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fdf6152e6874f78825e5eddb7f14158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:25.019146 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-e97e3ee6-3e9b-4015-a86c-1f02075714d2 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] 10.222.0.69 "GET /compute/v2.1/servers/c390424a-1a68-4b4f-abea-917428ba36e5" status: 200 len: 1318 microversion: 2.1 time: 0.208400 May 26 18:04:25.019889 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 196/426] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:24 2022] GET /compute/v2.1/servers/c390424a-1a68-4b4f-abea-917428ba36e5 => generated 1318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:25.073461 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-94b62667-89d8-4506-8ef8-22fdfbeede12 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "POST /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1/action" status: 202 len: 0 microversion: 2.20 time: 0.127050 May 26 18:04:25.074663 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 231/427] 10.222.0.69 () {62 vars in 1318 bytes} [Thu May 26 18:04:24 2022] POST /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 26 18:04:25.086864 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-df273cbf-a200-41c9-9350-caa3951d1153 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:25.088416 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-df273cbf-a200-41c9-9350-caa3951d1153 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:25.097386 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-df273cbf-a200-41c9-9350-caa3951d1153 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:25.097875 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-df273cbf-a200-41c9-9350-caa3951d1153 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:25.098666 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-df273cbf-a200-41c9-9350-caa3951d1153 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:25.099252 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-df273cbf-a200-41c9-9350-caa3951d1153 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:25.214928 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-26c9a9bc-70fe-48c6-951c-31d6a170aa2f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:25.215634 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-26c9a9bc-70fe-48c6-951c-31d6a170aa2f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 6bb99e9b-15af-408e-af01-6e08b8294058] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:25.226579 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-26c9a9bc-70fe-48c6-951c-31d6a170aa2f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:25.229748 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-26c9a9bc-70fe-48c6-951c-31d6a170aa2f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:25.235574 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-26c9a9bc-70fe-48c6-951c-31d6a170aa2f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:25.238359 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-26c9a9bc-70fe-48c6-951c-31d6a170aa2f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:25.403607 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-26c9a9bc-70fe-48c6-951c-31d6a170aa2f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:25.412618 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-26c9a9bc-70fe-48c6-951c-31d6a170aa2f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058" status: 200 len: 1310 microversion: 2.1 time: 0.204651 May 26 18:04:25.413397 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 232/428] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:25 2022] GET /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058 => generated 1310 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:25.545832 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-df273cbf-a200-41c9-9350-caa3951d1153 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:25.563824 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-df273cbf-a200-41c9-9350-caa3951d1153 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:25.568133 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-df273cbf-a200-41c9-9350-caa3951d1153 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:25.569822 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-df273cbf-a200-41c9-9350-caa3951d1153 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1750 microversion: 2.20 time: 0.490776 May 26 18:04:25.570953 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 197/429] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:04:25 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1750 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:25.956589 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [req-36d8c154-7231-4c63-8149-d01b6bddb32a req-8e9fa7c0-d0c9-456c-9e16-bd98979a81b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "704b23df-a1e8-425f-a6bf-4805b1356866", "tag": "b3168a60-01f6-45c3-989d-b7db5593ac6f"}]} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:04:25.960995 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:04:25.971248 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-36d8c154-7231-4c63-8149-d01b6bddb32a req-8e9fa7c0-d0c9-456c-9e16-bd98979a81b5 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:25.971692 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-36d8c154-7231-4c63-8149-d01b6bddb32a req-8e9fa7c0-d0c9-456c-9e16-bd98979a81b5 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:25.987322 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.compute.server_external_events [req-36d8c154-7231-4c63-8149-d01b6bddb32a req-8e9fa7c0-d0c9-456c-9e16-bd98979a81b5 service nova] Creating event network-changed:b3168a60-01f6-45c3-989d-b7db5593ac6f for instance 704b23df-a1e8-425f-a6bf-4805b1356866 on hv-cinder-83607 May 26 18:04:25.992465 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [req-36d8c154-7231-4c63-8149-d01b6bddb32a req-8e9fa7c0-d0c9-456c-9e16-bd98979a81b5 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040266 May 26 18:04:25.993391 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 233/430] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:04:26.037345 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-4465dd5e-d3fb-435f-a0e5-e50357701ca3 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:26.037860 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-4465dd5e-d3fb-435f-a0e5-e50357701ca3 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] [instance: c390424a-1a68-4b4f-abea-917428ba36e5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:26.046163 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4465dd5e-d3fb-435f-a0e5-e50357701ca3 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:26.046903 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4465dd5e-d3fb-435f-a0e5-e50357701ca3 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:26.047977 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4465dd5e-d3fb-435f-a0e5-e50357701ca3 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:26.048637 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4465dd5e-d3fb-435f-a0e5-e50357701ca3 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:26.314107 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-4465dd5e-d3fb-435f-a0e5-e50357701ca3 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b8f37c287341848d8d3b4d5f62873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fdf6152e6874f78825e5eddb7f14158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:26.330628 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-4465dd5e-d3fb-435f-a0e5-e50357701ca3 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] 10.222.0.69 "GET /compute/v2.1/servers/c390424a-1a68-4b4f-abea-917428ba36e5" status: 200 len: 1318 microversion: 2.1 time: 0.297210 May 26 18:04:26.333198 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 198/431] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:26 2022] GET /compute/v2.1/servers/c390424a-1a68-4b4f-abea-917428ba36e5 => generated 1318 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:26.434560 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-11ae8006-0118-4dc3-8120-3a8037e2a57c tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:26.436076 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-11ae8006-0118-4dc3-8120-3a8037e2a57c tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 6bb99e9b-15af-408e-af01-6e08b8294058] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:26.447242 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-11ae8006-0118-4dc3-8120-3a8037e2a57c tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:26.449399 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-11ae8006-0118-4dc3-8120-3a8037e2a57c tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:26.450941 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-11ae8006-0118-4dc3-8120-3a8037e2a57c tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:26.451628 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-11ae8006-0118-4dc3-8120-3a8037e2a57c tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:26.590386 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-5bffab9b-ee4a-4990-86ce-e2b69ac47d54 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:26.590947 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-5bffab9b-ee4a-4990-86ce-e2b69ac47d54 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:26.597585 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5bffab9b-ee4a-4990-86ce-e2b69ac47d54 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:26.598372 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5bffab9b-ee4a-4990-86ce-e2b69ac47d54 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:26.599325 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5bffab9b-ee4a-4990-86ce-e2b69ac47d54 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:26.600734 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5bffab9b-ee4a-4990-86ce-e2b69ac47d54 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:26.718984 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-11ae8006-0118-4dc3-8120-3a8037e2a57c tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:26.729413 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-11ae8006-0118-4dc3-8120-3a8037e2a57c tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058" status: 200 len: 1366 microversion: 2.1 time: 0.302601 May 26 18:04:26.731164 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 234/432] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:26 2022] GET /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058 => generated 1366 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:27.006932 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-5bffab9b-ee4a-4990-86ce-e2b69ac47d54 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:27.034832 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-5bffab9b-ee4a-4990-86ce-e2b69ac47d54 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:27.039736 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-5bffab9b-ee4a-4990-86ce-e2b69ac47d54 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:27.043723 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-5bffab9b-ee4a-4990-86ce-e2b69ac47d54 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1750 microversion: 2.20 time: 0.456856 May 26 18:04:27.045055 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 199/433] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:04:26 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1750 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:27.350827 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-8395606c-a485-483b-b220-61735290d2cb tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:27.351382 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-8395606c-a485-483b-b220-61735290d2cb tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] [instance: c390424a-1a68-4b4f-abea-917428ba36e5] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:27.360340 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-8395606c-a485-483b-b220-61735290d2cb tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:27.360807 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-8395606c-a485-483b-b220-61735290d2cb tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:27.361610 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-8395606c-a485-483b-b220-61735290d2cb tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:27.362134 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-8395606c-a485-483b-b220-61735290d2cb tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:27.544796 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-8395606c-a485-483b-b220-61735290d2cb tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b8f37c287341848d8d3b4d5f62873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fdf6152e6874f78825e5eddb7f14158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:27.557983 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-8395606c-a485-483b-b220-61735290d2cb tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] 10.222.0.69 "GET /compute/v2.1/servers/c390424a-1a68-4b4f-abea-917428ba36e5" status: 200 len: 1508 microversion: 2.1 time: 0.211551 May 26 18:04:27.564818 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 235/434] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:27 2022] GET /compute/v2.1/servers/c390424a-1a68-4b4f-abea-917428ba36e5 => generated 1508 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:27.577677 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-5219e453-faa7-477f-8566-c29e7518fa24 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c260889-1545-4df0-a330-3eb841d46c47", "device": "/dev/sdb"}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:04:27.579417 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-5219e453-faa7-477f-8566-c29e7518fa24 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] [instance: c390424a-1a68-4b4f-abea-917428ba36e5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:27.587478 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5219e453-faa7-477f-8566-c29e7518fa24 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:27.587939 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5219e453-faa7-477f-8566-c29e7518fa24 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:27.588759 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5219e453-faa7-477f-8566-c29e7518fa24 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:27.589841 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5219e453-faa7-477f-8566-c29e7518fa24 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:27.703894 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [req-8697adc6-80f2-4e4e-bb59-481bfbe6d391 req-4e3cc50f-a9c1-458d-9f95-ba924a2895d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bb99e9b-15af-408e-af01-6e08b8294058", "tag": "0dd6e103-d470-44be-a25f-1cd6fdfa887e"}]} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:04:27.726379 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-8697adc6-80f2-4e4e-bb59-481bfbe6d391 req-4e3cc50f-a9c1-458d-9f95-ba924a2895d7 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:27.727058 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-8697adc6-80f2-4e4e-bb59-481bfbe6d391 req-4e3cc50f-a9c1-458d-9f95-ba924a2895d7 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:27.744323 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.compute.server_external_events [req-8697adc6-80f2-4e4e-bb59-481bfbe6d391 req-4e3cc50f-a9c1-458d-9f95-ba924a2895d7 service nova] Creating event network-changed:0dd6e103-d470-44be-a25f-1cd6fdfa887e for instance 6bb99e9b-15af-408e-af01-6e08b8294058 on hv-cinder-83607 May 26 18:04:27.766134 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [req-8697adc6-80f2-4e4e-bb59-481bfbe6d391 req-4e3cc50f-a9c1-458d-9f95-ba924a2895d7 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068141 May 26 18:04:27.767277 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 236/435] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:04:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:04:27.774004 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-4db73cff-0d5d-4a23-bf0f-5330430b315a tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:27.774976 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-4db73cff-0d5d-4a23-bf0f-5330430b315a tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 6bb99e9b-15af-408e-af01-6e08b8294058] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:27.782936 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-4db73cff-0d5d-4a23-bf0f-5330430b315a tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:27.783396 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-4db73cff-0d5d-4a23-bf0f-5330430b315a tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:27.784578 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-4db73cff-0d5d-4a23-bf0f-5330430b315a tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:27.789247 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-4db73cff-0d5d-4a23-bf0f-5330430b315a tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:27.912968 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:04:27.937448 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-5219e453-faa7-477f-8566-c29e7518fa24 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] 10.222.0.69 "POST /compute/v2.1/servers/c390424a-1a68-4b4f-abea-917428ba36e5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.364222 May 26 18:04:27.938786 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 200/436] 10.222.0.69 () {60 vars in 1322 bytes} [Thu May 26 18:04:27 2022] POST /compute/v2.1/servers/c390424a-1a68-4b4f-abea-917428ba36e5/os-volume_attachments => generated 194 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:04:27.979255 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-4db73cff-0d5d-4a23-bf0f-5330430b315a tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:27.990261 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-4db73cff-0d5d-4a23-bf0f-5330430b315a tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058" status: 200 len: 1366 microversion: 2.1 time: 0.221713 May 26 18:04:28.001345 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 237/437] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:27 2022] GET /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058 => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:28.071492 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-59aefe78-38e6-4fb4-bfc8-80009e593b38 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:28.072468 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-59aefe78-38e6-4fb4-bfc8-80009e593b38 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:28.081822 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-59aefe78-38e6-4fb4-bfc8-80009e593b38 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:28.082269 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-59aefe78-38e6-4fb4-bfc8-80009e593b38 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:28.083040 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-59aefe78-38e6-4fb4-bfc8-80009e593b38 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:28.083630 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-59aefe78-38e6-4fb4-bfc8-80009e593b38 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:28.361099 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-59aefe78-38e6-4fb4-bfc8-80009e593b38 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:28.371610 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-59aefe78-38e6-4fb4-bfc8-80009e593b38 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:28.373454 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-59aefe78-38e6-4fb4-bfc8-80009e593b38 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:28.375503 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-59aefe78-38e6-4fb4-bfc8-80009e593b38 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1752 microversion: 2.20 time: 0.308604 May 26 18:04:28.375926 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 201/438] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:04:28 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1752 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:04:28.533257 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-5af4e4c4-8d05-4f5d-a82e-96365da6e442 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1488304280", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-631169157", "security_groups": [{"name": "tempest-secgroup-smoke-716661715"}], "networks": [{"uuid": "d296c6a1-d33e-4e01-be5a-7d337d513aef"}], "block_device_mapping_v2": [{"uuid": "1ec3cec1-62e3-40ba-b433-8945d5a995c9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:04:28.647836 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.network.neutron [None req-5af4e4c4-8d05-4f5d-a82e-96365da6e442 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] validate_networks() for [('d296c6a1-d33e-4e01-be5a-7d337d513aef', None, None, None, None, None)] {{(pid=117722) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:04:28.740430 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_cell0:SELECT=4 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:04:29.008761 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-585d501e-c309-4dfe-be2a-b28519d9e8b5 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:29.009348 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-585d501e-c309-4dfe-be2a-b28519d9e8b5 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 6bb99e9b-15af-408e-af01-6e08b8294058] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:29.016477 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-585d501e-c309-4dfe-be2a-b28519d9e8b5 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:29.016924 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-585d501e-c309-4dfe-be2a-b28519d9e8b5 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:29.017725 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-585d501e-c309-4dfe-be2a-b28519d9e8b5 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:29.021563 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-585d501e-c309-4dfe-be2a-b28519d9e8b5 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:29.044080 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.virt.hardware [None req-5af4e4c4-8d05-4f5d-a82e-96365da6e442 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Flavor limits 0:0:0 {{(pid=117722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:04:29.045051 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.virt.hardware [None req-5af4e4c4-8d05-4f5d-a82e-96365da6e442 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Image limits 0:0:0 {{(pid=117722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:04:29.046325 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.virt.hardware [None req-5af4e4c4-8d05-4f5d-a82e-96365da6e442 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Flavor pref 0:0:0 {{(pid=117722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:04:29.047265 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.virt.hardware [None req-5af4e4c4-8d05-4f5d-a82e-96365da6e442 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Image pref 0:0:0 {{(pid=117722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:04:29.048255 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.virt.hardware [None req-5af4e4c4-8d05-4f5d-a82e-96365da6e442 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:04:29.060483 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-5af4e4c4-8d05-4f5d-a82e-96365da6e442 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:29.060942 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-5af4e4c4-8d05-4f5d-a82e-96365da6e442 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:29.061919 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-5af4e4c4-8d05-4f5d-a82e-96365da6e442 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:29.062374 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-5af4e4c4-8d05-4f5d-a82e-96365da6e442 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:29.090139 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.quota [None req-5af4e4c4-8d05-4f5d-a82e-96365da6e442 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Getting quotas for project fce9015638524279b09969d5aacda2ba. Resources: {'instances', 'ram', 'cores'} {{(pid=117722) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:04:29.095123 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.quota [None req-5af4e4c4-8d05-4f5d-a82e-96365da6e442 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Getting quotas for user 0c8a0ec84d3c471f9e6baa548f0d045a and project fce9015638524279b09969d5aacda2ba. Resources: {'instances', 'ram', 'cores'} {{(pid=117722) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:04:29.182058 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-5af4e4c4-8d05-4f5d-a82e-96365da6e442 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Going to run 1 instances... {{(pid=117722) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:04:29.189133 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-5af4e4c4-8d05-4f5d-a82e-96365da6e442 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1ec3cec1-62e3-40ba-b433-8945d5a995c9',volume_size=None,volume_type=None)] {{(pid=117722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:04:29.217084 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-585d501e-c309-4dfe-be2a-b28519d9e8b5 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:29.226737 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-585d501e-c309-4dfe-be2a-b28519d9e8b5 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058" status: 200 len: 1366 microversion: 2.1 time: 0.222183 May 26 18:04:29.232812 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 202/439] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:29 2022] GET /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:29.349423 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-5af4e4c4-8d05-4f5d-a82e-96365da6e442 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.820019 May 26 18:04:29.350082 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 238/440] 10.222.0.69 () {60 vars in 1146 bytes} [Thu May 26 18:04:28 2022] POST /compute/v2.1/servers => generated 405 bytes in 821 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 18:04:29.362359 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-2b01a80e-a74c-414c-8b53-b204960fd9a8 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:29.363000 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-2b01a80e-a74c-414c-8b53-b204960fd9a8 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:29.366698 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:04:29.394770 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-1258404c-a0d7-4b52-8f4b-9a8372f08d37 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:29.395512 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-1258404c-a0d7-4b52-8f4b-9a8372f08d37 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:29.405395 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-1258404c-a0d7-4b52-8f4b-9a8372f08d37 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:29.406107 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-1258404c-a0d7-4b52-8f4b-9a8372f08d37 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:29.407076 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-1258404c-a0d7-4b52-8f4b-9a8372f08d37 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:29.407531 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-1258404c-a0d7-4b52-8f4b-9a8372f08d37 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:29.429935 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-2b01a80e-a74c-414c-8b53-b204960fd9a8 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:29.438053 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-2b01a80e-a74c-414c-8b53-b204960fd9a8 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1088 microversion: 2.1 time: 0.080526 May 26 18:04:29.438971 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 203/441] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:29 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1088 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:04:29.560807 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-1258404c-a0d7-4b52-8f4b-9a8372f08d37 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:29.569824 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-1258404c-a0d7-4b52-8f4b-9a8372f08d37 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:29.571599 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-1258404c-a0d7-4b52-8f4b-9a8372f08d37 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:29.573095 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-1258404c-a0d7-4b52-8f4b-9a8372f08d37 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1808 microversion: 2.20 time: 0.182244 May 26 18:04:29.585755 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 239/442] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:04:29 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:04:30.244042 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-befe2569-d139-405b-b76b-dca84082a9dc tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:30.244646 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-befe2569-d139-405b-b76b-dca84082a9dc tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 6bb99e9b-15af-408e-af01-6e08b8294058] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:30.252312 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-befe2569-d139-405b-b76b-dca84082a9dc tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:30.252756 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-befe2569-d139-405b-b76b-dca84082a9dc tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:30.253515 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-befe2569-d139-405b-b76b-dca84082a9dc tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:30.253943 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-befe2569-d139-405b-b76b-dca84082a9dc tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:30.456346 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-86f81e19-3bdf-47fe-9023-34cf31b77e49 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:30.456899 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-86f81e19-3bdf-47fe-9023-34cf31b77e49 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:30.463400 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-86f81e19-3bdf-47fe-9023-34cf31b77e49 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:30.464403 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-86f81e19-3bdf-47fe-9023-34cf31b77e49 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:30.465575 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-86f81e19-3bdf-47fe-9023-34cf31b77e49 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:30.466029 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-86f81e19-3bdf-47fe-9023-34cf31b77e49 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:30.534409 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-86f81e19-3bdf-47fe-9023-34cf31b77e49 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:30.544283 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-86f81e19-3bdf-47fe-9023-34cf31b77e49 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1194 microversion: 2.1 time: 0.092248 May 26 18:04:30.544973 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 240/443] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:30 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1194 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:30.593273 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-32b6fe61-ab42-49d3-bacf-0fa51f48d820 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:30.594127 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-32b6fe61-ab42-49d3-bacf-0fa51f48d820 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:30.601030 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-32b6fe61-ab42-49d3-bacf-0fa51f48d820 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:30.601581 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-32b6fe61-ab42-49d3-bacf-0fa51f48d820 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:30.602698 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-32b6fe61-ab42-49d3-bacf-0fa51f48d820 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:30.603211 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-32b6fe61-ab42-49d3-bacf-0fa51f48d820 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:30.746437 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-32b6fe61-ab42-49d3-bacf-0fa51f48d820 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:30.756157 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-32b6fe61-ab42-49d3-bacf-0fa51f48d820 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:30.757397 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-32b6fe61-ab42-49d3-bacf-0fa51f48d820 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:30.758600 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-32b6fe61-ab42-49d3-bacf-0fa51f48d820 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1808 microversion: 2.20 time: 0.169537 May 26 18:04:30.759170 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 241/444] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:04:30 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:04:30.823397 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-befe2569-d139-405b-b76b-dca84082a9dc tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:30.831167 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-befe2569-d139-405b-b76b-dca84082a9dc tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058" status: 200 len: 1366 microversion: 2.1 time: 0.590950 May 26 18:04:30.831742 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 204/445] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:30 2022] GET /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058 => generated 1366 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:31.562326 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-83ea4b71-ce50-4420-917a-77d6259f51dd tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:31.563578 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-83ea4b71-ce50-4420-917a-77d6259f51dd tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:31.570521 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-83ea4b71-ce50-4420-917a-77d6259f51dd tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:31.571052 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-83ea4b71-ce50-4420-917a-77d6259f51dd tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:31.572431 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-83ea4b71-ce50-4420-917a-77d6259f51dd tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:31.572431 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-83ea4b71-ce50-4420-917a-77d6259f51dd tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:31.643846 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-83ea4b71-ce50-4420-917a-77d6259f51dd tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:31.652107 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-83ea4b71-ce50-4420-917a-77d6259f51dd tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1204 microversion: 2.1 time: 0.093774 May 26 18:04:31.652658 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 242/446] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:31 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1204 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:31.777432 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-2ba7ed10-f31b-4174-9f1f-60fec53a2a90 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:31.778137 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-2ba7ed10-f31b-4174-9f1f-60fec53a2a90 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:31.783692 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell0:SELECT=2 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:04:31.785697 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2ba7ed10-f31b-4174-9f1f-60fec53a2a90 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:31.786314 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2ba7ed10-f31b-4174-9f1f-60fec53a2a90 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:31.787327 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2ba7ed10-f31b-4174-9f1f-60fec53a2a90 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:31.787960 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2ba7ed10-f31b-4174-9f1f-60fec53a2a90 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:31.848963 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-2f81f238-c675-4918-a7df-53e4910a3c99 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:31.850006 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-2f81f238-c675-4918-a7df-53e4910a3c99 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 6bb99e9b-15af-408e-af01-6e08b8294058] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:31.859129 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-2f81f238-c675-4918-a7df-53e4910a3c99 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:31.859792 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-2f81f238-c675-4918-a7df-53e4910a3c99 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:31.860748 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-2f81f238-c675-4918-a7df-53e4910a3c99 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:31.861410 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-2f81f238-c675-4918-a7df-53e4910a3c99 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:31.878809 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:04:32.033453 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-2f81f238-c675-4918-a7df-53e4910a3c99 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:32.040201 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-2ba7ed10-f31b-4174-9f1f-60fec53a2a90 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:32.048379 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-2f81f238-c675-4918-a7df-53e4910a3c99 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058" status: 200 len: 1366 microversion: 2.1 time: 0.202900 May 26 18:04:32.049553 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 243/447] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:31 2022] GET /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058 => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:04:32.053701 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-2ba7ed10-f31b-4174-9f1f-60fec53a2a90 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:32.056087 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-2ba7ed10-f31b-4174-9f1f-60fec53a2a90 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:32.058472 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-2ba7ed10-f31b-4174-9f1f-60fec53a2a90 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1808 microversion: 2.20 time: 0.284464 May 26 18:04:32.059599 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 205/448] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:04:31 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1808 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:04:32.678662 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-bc86f5e1-3793-4491-829e-b20fbdd9e43f tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:32.685305 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-bc86f5e1-3793-4491-829e-b20fbdd9e43f tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:32.713997 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-bc86f5e1-3793-4491-829e-b20fbdd9e43f tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:32.716103 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-bc86f5e1-3793-4491-829e-b20fbdd9e43f tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:32.717276 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-bc86f5e1-3793-4491-829e-b20fbdd9e43f tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:32.717940 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-bc86f5e1-3793-4491-829e-b20fbdd9e43f tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:33.049125 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-bc86f5e1-3793-4491-829e-b20fbdd9e43f tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:33.064781 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-bc86f5e1-3793-4491-829e-b20fbdd9e43f tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1271 microversion: 2.1 time: 0.398949 May 26 18:04:33.066149 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 244/449] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:32 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1271 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:33.077882 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-e8e0080d-c878-4135-abec-37467368f73f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:33.078464 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-64159287-257e-4111-838c-2c3ec3ee15fd tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:33.079243 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-64159287-257e-4111-838c-2c3ec3ee15fd tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:33.079655 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-e8e0080d-c878-4135-abec-37467368f73f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 6bb99e9b-15af-408e-af01-6e08b8294058] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:33.092669 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e8e0080d-c878-4135-abec-37467368f73f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:33.093615 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-64159287-257e-4111-838c-2c3ec3ee15fd tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:33.094079 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-64159287-257e-4111-838c-2c3ec3ee15fd tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:33.095493 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e8e0080d-c878-4135-abec-37467368f73f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:33.096622 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e8e0080d-c878-4135-abec-37467368f73f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:33.099042 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e8e0080d-c878-4135-abec-37467368f73f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:33.109096 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-64159287-257e-4111-838c-2c3ec3ee15fd tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:33.116068 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-64159287-257e-4111-838c-2c3ec3ee15fd tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:33.350658 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-64159287-257e-4111-838c-2c3ec3ee15fd tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:33.361364 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-64159287-257e-4111-838c-2c3ec3ee15fd tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:33.363068 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-64159287-257e-4111-838c-2c3ec3ee15fd tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:33.364732 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-64159287-257e-4111-838c-2c3ec3ee15fd tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1808 microversion: 2.20 time: 0.291631 May 26 18:04:33.365884 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 245/450] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:04:33 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1808 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:33.376329 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [req-36d4d46a-a5eb-47b6-ba4d-92c52ea9ddcc req-52efc62a-4514-4c21-9303-1a317b3d721f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e417922-03b2-40d5-814a-4303948ed31b", "tag": "971e49f3-13e4-4d71-a577-21b1d36cef54"}]} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:04:33.393112 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-e8e0080d-c878-4135-abec-37467368f73f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:33.403038 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-e8e0080d-c878-4135-abec-37467368f73f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058" status: 200 len: 1366 microversion: 2.1 time: 0.340394 May 26 18:04:33.403632 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 206/451] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:33 2022] GET /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058 => generated 1366 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:33.412754 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-36d4d46a-a5eb-47b6-ba4d-92c52ea9ddcc req-52efc62a-4514-4c21-9303-1a317b3d721f service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:33.412754 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-36d4d46a-a5eb-47b6-ba4d-92c52ea9ddcc req-52efc62a-4514-4c21-9303-1a317b3d721f service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:33.424350 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.compute.server_external_events [req-36d4d46a-a5eb-47b6-ba4d-92c52ea9ddcc req-52efc62a-4514-4c21-9303-1a317b3d721f service nova] Creating event network-changed:971e49f3-13e4-4d71-a577-21b1d36cef54 for instance 8e417922-03b2-40d5-814a-4303948ed31b on hv-cinder-83607 May 26 18:04:33.429627 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [req-36d4d46a-a5eb-47b6-ba4d-92c52ea9ddcc req-52efc62a-4514-4c21-9303-1a317b3d721f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062566 May 26 18:04:33.430238 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 246/452] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:04:34.084047 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-b884da27-5d1b-4313-b933-b7fddd6d8d2e tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:34.084577 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-b884da27-5d1b-4313-b933-b7fddd6d8d2e tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:34.091850 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b884da27-5d1b-4313-b933-b7fddd6d8d2e tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:34.092327 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b884da27-5d1b-4313-b933-b7fddd6d8d2e tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:34.093148 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b884da27-5d1b-4313-b933-b7fddd6d8d2e tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:34.093566 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b884da27-5d1b-4313-b933-b7fddd6d8d2e tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:34.254333 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-b884da27-5d1b-4313-b933-b7fddd6d8d2e tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:34.263314 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-b884da27-5d1b-4313-b933-b7fddd6d8d2e tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1271 microversion: 2.1 time: 0.183184 May 26 18:04:34.264662 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 207/453] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:34 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1271 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:34.389728 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-1cbe8b4e-695f-428e-8007-4902561891b9 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:34.391004 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-1cbe8b4e-695f-428e-8007-4902561891b9 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:34.407193 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-1cbe8b4e-695f-428e-8007-4902561891b9 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:34.408327 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-1cbe8b4e-695f-428e-8007-4902561891b9 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:34.409790 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-1cbe8b4e-695f-428e-8007-4902561891b9 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:34.410583 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-1cbe8b4e-695f-428e-8007-4902561891b9 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:34.417846 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-072e3c23-54fb-43dc-824b-3240a8c0a1a3 req-b789d152-1df9-48b8-8f89-9e57e32c580b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bb99e9b-15af-408e-af01-6e08b8294058", "name": "network-vif-plugged", "status": "completed", "tag": "0dd6e103-d470-44be-a25f-1cd6fdfa887e"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:04:34.427623 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-072e3c23-54fb-43dc-824b-3240a8c0a1a3 req-b789d152-1df9-48b8-8f89-9e57e32c580b service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:34.428250 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-072e3c23-54fb-43dc-824b-3240a8c0a1a3 req-b789d152-1df9-48b8-8f89-9e57e32c580b service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:34.455297 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-072e3c23-54fb-43dc-824b-3240a8c0a1a3 req-b789d152-1df9-48b8-8f89-9e57e32c580b service nova] Creating event network-vif-plugged:0dd6e103-d470-44be-a25f-1cd6fdfa887e for instance 6bb99e9b-15af-408e-af01-6e08b8294058 on hv-cinder-83607 May 26 18:04:34.464397 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-072e3c23-54fb-43dc-824b-3240a8c0a1a3 req-b789d152-1df9-48b8-8f89-9e57e32c580b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051764 May 26 18:04:34.465348 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 208/454] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:04:34.490792 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-53a8363b-7850-46f1-b910-81bde6f8598d tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:34.495887 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-53a8363b-7850-46f1-b910-81bde6f8598d tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 6bb99e9b-15af-408e-af01-6e08b8294058] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:34.519089 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-53a8363b-7850-46f1-b910-81bde6f8598d tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:34.519723 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-53a8363b-7850-46f1-b910-81bde6f8598d tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:34.520892 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-53a8363b-7850-46f1-b910-81bde6f8598d tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:34.521581 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-53a8363b-7850-46f1-b910-81bde6f8598d tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:34.688205 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-1cbe8b4e-695f-428e-8007-4902561891b9 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:34.699445 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-1cbe8b4e-695f-428e-8007-4902561891b9 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:34.702344 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-1cbe8b4e-695f-428e-8007-4902561891b9 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:34.703905 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-1cbe8b4e-695f-428e-8007-4902561891b9 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1808 microversion: 2.20 time: 0.321857 May 26 18:04:34.706351 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 247/455] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:04:34 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1808 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:34.787955 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-53a8363b-7850-46f1-b910-81bde6f8598d tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:34.812964 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-53a8363b-7850-46f1-b910-81bde6f8598d tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058" status: 200 len: 1366 microversion: 2.1 time: 0.333255 May 26 18:04:34.813567 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 209/456] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:34 2022] GET /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058 => generated 1366 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:35.282598 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-47f69ce0-dad4-4fcb-99c3-721ceaf8d6b3 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:35.283209 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-47f69ce0-dad4-4fcb-99c3-721ceaf8d6b3 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:35.292776 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-47f69ce0-dad4-4fcb-99c3-721ceaf8d6b3 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:35.293313 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-47f69ce0-dad4-4fcb-99c3-721ceaf8d6b3 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:35.293909 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-47f69ce0-dad4-4fcb-99c3-721ceaf8d6b3 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:35.294694 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-47f69ce0-dad4-4fcb-99c3-721ceaf8d6b3 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:35.488339 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-47f69ce0-dad4-4fcb-99c3-721ceaf8d6b3 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:35.504416 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-47f69ce0-dad4-4fcb-99c3-721ceaf8d6b3 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1271 microversion: 2.1 time: 0.225368 May 26 18:04:35.505623 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 248/457] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:35 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1271 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:35.739393 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-ca850c41-89b4-46d4-a2e7-9053f084bc68 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:35.740721 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-ca850c41-89b4-46d4-a2e7-9053f084bc68 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:35.748550 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ca850c41-89b4-46d4-a2e7-9053f084bc68 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:35.749000 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ca850c41-89b4-46d4-a2e7-9053f084bc68 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:35.752919 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ca850c41-89b4-46d4-a2e7-9053f084bc68 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:35.752919 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ca850c41-89b4-46d4-a2e7-9053f084bc68 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:35.843202 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-8a2e7ee2-c2de-433b-b142-435faf02137a tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:35.844187 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-8a2e7ee2-c2de-433b-b142-435faf02137a tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 6bb99e9b-15af-408e-af01-6e08b8294058] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:35.858603 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-8a2e7ee2-c2de-433b-b142-435faf02137a tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:35.859378 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-8a2e7ee2-c2de-433b-b142-435faf02137a tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:35.860864 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-8a2e7ee2-c2de-433b-b142-435faf02137a tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:35.861653 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-8a2e7ee2-c2de-433b-b142-435faf02137a tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:36.010955 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-ca850c41-89b4-46d4-a2e7-9053f084bc68 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:36.030711 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-ca850c41-89b4-46d4-a2e7-9053f084bc68 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:36.034246 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-ca850c41-89b4-46d4-a2e7-9053f084bc68 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:36.036818 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-ca850c41-89b4-46d4-a2e7-9053f084bc68 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1808 microversion: 2.20 time: 0.301229 May 26 18:04:36.038134 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 210/458] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:04:35 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1808 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:36.131462 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-8a2e7ee2-c2de-433b-b142-435faf02137a tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:36.146675 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-8a2e7ee2-c2de-433b-b142-435faf02137a tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058" status: 200 len: 1366 microversion: 2.1 time: 0.316581 May 26 18:04:36.148247 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 249/459] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:35 2022] GET /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058 => generated 1366 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:36.530130 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-53c93b4e-243c-4137-87eb-a396870148a9 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:36.530774 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-53c93b4e-243c-4137-87eb-a396870148a9 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:36.537069 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-53c93b4e-243c-4137-87eb-a396870148a9 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:36.537520 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-53c93b4e-243c-4137-87eb-a396870148a9 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:36.538299 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-53c93b4e-243c-4137-87eb-a396870148a9 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:36.538734 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-53c93b4e-243c-4137-87eb-a396870148a9 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:36.844418 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-53c93b4e-243c-4137-87eb-a396870148a9 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:36.855429 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-53c93b4e-243c-4137-87eb-a396870148a9 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1271 microversion: 2.1 time: 0.329778 May 26 18:04:36.856031 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 211/460] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:36 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1271 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:37.055199 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-b793c75c-4f3a-44f4-bacf-80666f158073 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:37.056391 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-b793c75c-4f3a-44f4-bacf-80666f158073 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:37.068900 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b793c75c-4f3a-44f4-bacf-80666f158073 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:37.069642 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b793c75c-4f3a-44f4-bacf-80666f158073 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:37.070982 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b793c75c-4f3a-44f4-bacf-80666f158073 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:37.071981 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b793c75c-4f3a-44f4-bacf-80666f158073 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:37.165564 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-86a3d8c9-bed6-42be-8413-0e238f869203 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:37.166167 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-86a3d8c9-bed6-42be-8413-0e238f869203 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 6bb99e9b-15af-408e-af01-6e08b8294058] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:37.173514 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-86a3d8c9-bed6-42be-8413-0e238f869203 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:37.174268 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-86a3d8c9-bed6-42be-8413-0e238f869203 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:37.175537 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-86a3d8c9-bed6-42be-8413-0e238f869203 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:37.176175 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-86a3d8c9-bed6-42be-8413-0e238f869203 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:37.310437 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-b793c75c-4f3a-44f4-bacf-80666f158073 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:37.327616 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-b793c75c-4f3a-44f4-bacf-80666f158073 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:37.330675 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-b793c75c-4f3a-44f4-bacf-80666f158073 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:37.332853 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-b793c75c-4f3a-44f4-bacf-80666f158073 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1808 microversion: 2.20 time: 0.281543 May 26 18:04:37.334433 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 250/461] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:04:37 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1808 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:04:37.409267 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-86a3d8c9-bed6-42be-8413-0e238f869203 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:37.414920 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-86a3d8c9-bed6-42be-8413-0e238f869203 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058" status: 200 len: 1366 microversion: 2.1 time: 0.253383 May 26 18:04:37.415514 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 212/462] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:37 2022] GET /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058 => generated 1366 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:04:37.890274 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-cb570de6-320c-4acb-b3db-cc7a3ee72464 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:37.891411 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-cb570de6-320c-4acb-b3db-cc7a3ee72464 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:37.903060 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-cb570de6-320c-4acb-b3db-cc7a3ee72464 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:37.903764 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-cb570de6-320c-4acb-b3db-cc7a3ee72464 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:37.905128 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-cb570de6-320c-4acb-b3db-cc7a3ee72464 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:37.905939 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-cb570de6-320c-4acb-b3db-cc7a3ee72464 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:38.118315 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-cb570de6-320c-4acb-b3db-cc7a3ee72464 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:38.129339 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-cb570de6-320c-4acb-b3db-cc7a3ee72464 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1271 microversion: 2.1 time: 0.248038 May 26 18:04:38.130039 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 251/463] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:37 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1271 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:38.354484 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-c2c5b875-7a6f-4db8-8eff-df57ab6287d2 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:38.355464 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-c2c5b875-7a6f-4db8-8eff-df57ab6287d2 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:38.365576 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c2c5b875-7a6f-4db8-8eff-df57ab6287d2 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:38.366330 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c2c5b875-7a6f-4db8-8eff-df57ab6287d2 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:38.367641 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c2c5b875-7a6f-4db8-8eff-df57ab6287d2 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:38.368389 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c2c5b875-7a6f-4db8-8eff-df57ab6287d2 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:38.436428 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-854a2d68-c442-4e98-8761-feecb6080fa2 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:38.437296 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-854a2d68-c442-4e98-8761-feecb6080fa2 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 6bb99e9b-15af-408e-af01-6e08b8294058] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:38.443630 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-854a2d68-c442-4e98-8761-feecb6080fa2 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:38.444290 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-854a2d68-c442-4e98-8761-feecb6080fa2 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:38.445009 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-854a2d68-c442-4e98-8761-feecb6080fa2 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:38.445523 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-854a2d68-c442-4e98-8761-feecb6080fa2 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:38.522549 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-c2c5b875-7a6f-4db8-8eff-df57ab6287d2 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:38.532294 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-c2c5b875-7a6f-4db8-8eff-df57ab6287d2 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:38.533947 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-c2c5b875-7a6f-4db8-8eff-df57ab6287d2 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:38.535244 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-c2c5b875-7a6f-4db8-8eff-df57ab6287d2 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1808 microversion: 2.20 time: 0.185864 May 26 18:04:38.535908 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 213/464] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:04:38 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1808 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:04:38.608479 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-854a2d68-c442-4e98-8761-feecb6080fa2 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:38.618564 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-854a2d68-c442-4e98-8761-feecb6080fa2 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058" status: 200 len: 1366 microversion: 2.1 time: 0.187098 May 26 18:04:38.619351 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 252/465] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:38 2022] GET /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058 => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:04:39.148570 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-3e1e2de7-e891-45a5-b245-47e5da82ab53 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:39.149111 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-3e1e2de7-e891-45a5-b245-47e5da82ab53 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:39.156751 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3e1e2de7-e891-45a5-b245-47e5da82ab53 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:39.157206 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3e1e2de7-e891-45a5-b245-47e5da82ab53 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:39.157998 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3e1e2de7-e891-45a5-b245-47e5da82ab53 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:39.158432 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3e1e2de7-e891-45a5-b245-47e5da82ab53 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:39.324508 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-3e1e2de7-e891-45a5-b245-47e5da82ab53 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:39.333034 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-3e1e2de7-e891-45a5-b245-47e5da82ab53 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1271 microversion: 2.1 time: 0.188309 May 26 18:04:39.334839 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 214/466] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:39 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1271 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:39.559488 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-6759e730-fe79-4e27-85e6-48f5711d2e9f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:39.560175 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-6759e730-fe79-4e27-85e6-48f5711d2e9f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:39.562666 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_cell0:SELECT=2 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:04:39.563497 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_cell0:SELECT=6 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:04:39.569219 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-6759e730-fe79-4e27-85e6-48f5711d2e9f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:39.569716 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-6759e730-fe79-4e27-85e6-48f5711d2e9f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:39.570651 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-6759e730-fe79-4e27-85e6-48f5711d2e9f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:39.571510 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-6759e730-fe79-4e27-85e6-48f5711d2e9f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:39.639382 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-edb0675d-d201-4f36-88be-2d50018517c4 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:39.640161 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-edb0675d-d201-4f36-88be-2d50018517c4 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 6bb99e9b-15af-408e-af01-6e08b8294058] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:39.642882 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell0:SELECT=10 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:04:39.663047 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-edb0675d-d201-4f36-88be-2d50018517c4 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:39.663563 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-edb0675d-d201-4f36-88be-2d50018517c4 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:39.669759 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-edb0675d-d201-4f36-88be-2d50018517c4 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:39.670306 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-edb0675d-d201-4f36-88be-2d50018517c4 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:39.770595 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-6759e730-fe79-4e27-85e6-48f5711d2e9f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:39.780133 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-6759e730-fe79-4e27-85e6-48f5711d2e9f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:39.781704 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-6759e730-fe79-4e27-85e6-48f5711d2e9f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:39.782924 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-6759e730-fe79-4e27-85e6-48f5711d2e9f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1808 microversion: 2.20 time: 0.228128 May 26 18:04:39.783499 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 253/467] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:04:39 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1808 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:04:39.871128 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-edb0675d-d201-4f36-88be-2d50018517c4 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:39.885125 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-edb0675d-d201-4f36-88be-2d50018517c4 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058" status: 200 len: 1366 microversion: 2.1 time: 0.251523 May 26 18:04:39.886084 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 215/468] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:39 2022] GET /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058 => generated 1366 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:40.352691 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-ef7844cf-f4a1-426b-b6b0-fa90809a020d tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:40.353205 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-ef7844cf-f4a1-426b-b6b0-fa90809a020d tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:40.360787 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ef7844cf-f4a1-426b-b6b0-fa90809a020d tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:40.361235 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ef7844cf-f4a1-426b-b6b0-fa90809a020d tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:40.362041 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ef7844cf-f4a1-426b-b6b0-fa90809a020d tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:40.362490 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ef7844cf-f4a1-426b-b6b0-fa90809a020d tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:40.524061 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-ef7844cf-f4a1-426b-b6b0-fa90809a020d tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:40.535361 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-ef7844cf-f4a1-426b-b6b0-fa90809a020d tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1271 microversion: 2.1 time: 0.185251 May 26 18:04:40.535361 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 254/469] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:40 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1271 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:04:40.802078 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-63d453b6-e165-42de-8ef8-8377b571f55f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:40.802723 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-63d453b6-e165-42de-8ef8-8377b571f55f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:40.809493 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-63d453b6-e165-42de-8ef8-8377b571f55f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:40.810035 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-63d453b6-e165-42de-8ef8-8377b571f55f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:40.811381 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-63d453b6-e165-42de-8ef8-8377b571f55f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:40.812304 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-63d453b6-e165-42de-8ef8-8377b571f55f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:40.905028 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-3c97fa8c-854e-42f2-bc1b-6ad036a9731d tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:40.905674 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-3c97fa8c-854e-42f2-bc1b-6ad036a9731d tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 6bb99e9b-15af-408e-af01-6e08b8294058] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:40.913498 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3c97fa8c-854e-42f2-bc1b-6ad036a9731d tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:40.913954 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3c97fa8c-854e-42f2-bc1b-6ad036a9731d tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:40.914777 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3c97fa8c-854e-42f2-bc1b-6ad036a9731d tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:40.915223 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3c97fa8c-854e-42f2-bc1b-6ad036a9731d tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:41.029607 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-63d453b6-e165-42de-8ef8-8377b571f55f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:41.049005 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-63d453b6-e165-42de-8ef8-8377b571f55f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:41.052460 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-63d453b6-e165-42de-8ef8-8377b571f55f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:41.054793 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-63d453b6-e165-42de-8ef8-8377b571f55f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1808 microversion: 2.20 time: 0.256343 May 26 18:04:41.056266 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 216/470] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:04:40 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1808 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:41.133334 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-3c97fa8c-854e-42f2-bc1b-6ad036a9731d tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:41.147734 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-3c97fa8c-854e-42f2-bc1b-6ad036a9731d tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058" status: 200 len: 1366 microversion: 2.1 time: 0.246477 May 26 18:04:41.148992 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 255/471] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:40 2022] GET /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058 => generated 1366 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:04:41.552260 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-678785a9-d134-433f-9bbd-6d46d840fb46 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:41.553346 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-678785a9-d134-433f-9bbd-6d46d840fb46 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:41.566094 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-678785a9-d134-433f-9bbd-6d46d840fb46 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:41.566778 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-678785a9-d134-433f-9bbd-6d46d840fb46 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:41.568345 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-678785a9-d134-433f-9bbd-6d46d840fb46 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:41.568980 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-678785a9-d134-433f-9bbd-6d46d840fb46 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:41.836311 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-678785a9-d134-433f-9bbd-6d46d840fb46 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:41.846882 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-678785a9-d134-433f-9bbd-6d46d840fb46 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1271 microversion: 2.1 time: 0.299590 May 26 18:04:41.848356 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 217/472] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:41 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1271 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:04:42.079732 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-e51f6aac-06f1-4f2b-acd8-1ec47116bfd7 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:42.080894 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-e51f6aac-06f1-4f2b-acd8-1ec47116bfd7 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:42.095081 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e51f6aac-06f1-4f2b-acd8-1ec47116bfd7 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:42.095879 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e51f6aac-06f1-4f2b-acd8-1ec47116bfd7 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:42.097309 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e51f6aac-06f1-4f2b-acd8-1ec47116bfd7 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:42.098094 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e51f6aac-06f1-4f2b-acd8-1ec47116bfd7 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:42.184923 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-3887a2be-7306-4ed4-97d1-f6fb05062428 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:42.186766 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-3887a2be-7306-4ed4-97d1-f6fb05062428 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 6bb99e9b-15af-408e-af01-6e08b8294058] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:42.199144 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3887a2be-7306-4ed4-97d1-f6fb05062428 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:42.200840 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3887a2be-7306-4ed4-97d1-f6fb05062428 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:42.202350 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3887a2be-7306-4ed4-97d1-f6fb05062428 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:42.203163 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3887a2be-7306-4ed4-97d1-f6fb05062428 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:42.332136 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-e51f6aac-06f1-4f2b-acd8-1ec47116bfd7 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:42.343376 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-e51f6aac-06f1-4f2b-acd8-1ec47116bfd7 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:42.345096 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-e51f6aac-06f1-4f2b-acd8-1ec47116bfd7 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:42.346528 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-e51f6aac-06f1-4f2b-acd8-1ec47116bfd7 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1808 microversion: 2.20 time: 0.275201 May 26 18:04:42.347167 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 256/473] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:04:42 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1808 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:42.402533 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-3887a2be-7306-4ed4-97d1-f6fb05062428 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:42.406218 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:04:42.411620 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-3887a2be-7306-4ed4-97d1-f6fb05062428 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058" status: 200 len: 1366 microversion: 2.1 time: 0.239907 May 26 18:04:42.412313 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 218/474] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:42 2022] GET /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058 => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:42.872434 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-28518388-2da3-4302-bb7c-9b81c3a73cb9 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:42.873089 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-28518388-2da3-4302-bb7c-9b81c3a73cb9 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:42.880253 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-28518388-2da3-4302-bb7c-9b81c3a73cb9 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:42.880703 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-28518388-2da3-4302-bb7c-9b81c3a73cb9 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:42.881501 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-28518388-2da3-4302-bb7c-9b81c3a73cb9 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:42.882126 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-28518388-2da3-4302-bb7c-9b81c3a73cb9 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:43.053421 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-28518388-2da3-4302-bb7c-9b81c3a73cb9 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:43.062000 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-28518388-2da3-4302-bb7c-9b81c3a73cb9 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1271 microversion: 2.1 time: 0.194549 May 26 18:04:43.062605 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 257/475] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:42 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1271 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:43.367330 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-62607da5-01bb-4a86-9429-c4523acc5184 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:43.368380 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-62607da5-01bb-4a86-9429-c4523acc5184 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:43.379394 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-62607da5-01bb-4a86-9429-c4523acc5184 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:43.380050 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-62607da5-01bb-4a86-9429-c4523acc5184 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:43.381185 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-62607da5-01bb-4a86-9429-c4523acc5184 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:43.381704 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-62607da5-01bb-4a86-9429-c4523acc5184 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:43.434871 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-d1811879-7e87-4791-aaff-00db1cb3eb7c tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:43.436007 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-d1811879-7e87-4791-aaff-00db1cb3eb7c tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 6bb99e9b-15af-408e-af01-6e08b8294058] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:43.449875 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d1811879-7e87-4791-aaff-00db1cb3eb7c tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:43.450681 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d1811879-7e87-4791-aaff-00db1cb3eb7c tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:43.452123 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d1811879-7e87-4791-aaff-00db1cb3eb7c tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:43.452876 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d1811879-7e87-4791-aaff-00db1cb3eb7c tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:43.564681 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-62607da5-01bb-4a86-9429-c4523acc5184 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:43.582036 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-62607da5-01bb-4a86-9429-c4523acc5184 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:43.585091 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-62607da5-01bb-4a86-9429-c4523acc5184 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:43.587488 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-62607da5-01bb-4a86-9429-c4523acc5184 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1808 microversion: 2.20 time: 0.224572 May 26 18:04:43.589271 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 219/476] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:04:43 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1808 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:43.653987 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-d1811879-7e87-4791-aaff-00db1cb3eb7c tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:43.662310 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-d1811879-7e87-4791-aaff-00db1cb3eb7c tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058" status: 200 len: 1366 microversion: 2.1 time: 0.235177 May 26 18:04:43.662919 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 258/477] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:43 2022] GET /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058 => generated 1366 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:44.080121 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-d7b1e57c-8ffd-4446-b89a-118840824b47 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:44.080926 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-d7b1e57c-8ffd-4446-b89a-118840824b47 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:44.088572 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d7b1e57c-8ffd-4446-b89a-118840824b47 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:44.089024 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d7b1e57c-8ffd-4446-b89a-118840824b47 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:44.089815 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d7b1e57c-8ffd-4446-b89a-118840824b47 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:44.090252 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d7b1e57c-8ffd-4446-b89a-118840824b47 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:44.246220 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-d7b1e57c-8ffd-4446-b89a-118840824b47 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:44.255078 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-d7b1e57c-8ffd-4446-b89a-118840824b47 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1271 microversion: 2.1 time: 0.179009 May 26 18:04:44.255685 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 220/478] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:44 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1271 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:04:44.612135 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-cc17058e-9fdc-4e12-8345-ddda68207a8b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:44.612877 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-cc17058e-9fdc-4e12-8345-ddda68207a8b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:44.620302 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-cc17058e-9fdc-4e12-8345-ddda68207a8b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:44.620875 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-cc17058e-9fdc-4e12-8345-ddda68207a8b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:44.621692 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-cc17058e-9fdc-4e12-8345-ddda68207a8b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:44.622133 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-cc17058e-9fdc-4e12-8345-ddda68207a8b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:44.679834 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-ccf341e2-0399-4820-a58a-412045e993c8 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:44.680936 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-ccf341e2-0399-4820-a58a-412045e993c8 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 6bb99e9b-15af-408e-af01-6e08b8294058] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:44.689139 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ccf341e2-0399-4820-a58a-412045e993c8 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:44.689751 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ccf341e2-0399-4820-a58a-412045e993c8 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:44.691219 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ccf341e2-0399-4820-a58a-412045e993c8 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:44.691769 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ccf341e2-0399-4820-a58a-412045e993c8 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:44.792275 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-cc17058e-9fdc-4e12-8345-ddda68207a8b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:44.810694 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-cc17058e-9fdc-4e12-8345-ddda68207a8b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:44.814538 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-cc17058e-9fdc-4e12-8345-ddda68207a8b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:44.817067 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-cc17058e-9fdc-4e12-8345-ddda68207a8b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1808 microversion: 2.20 time: 0.208988 May 26 18:04:44.832647 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 259/479] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:04:44 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1808 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:44.999544 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-ccf341e2-0399-4820-a58a-412045e993c8 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:45.011568 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-ccf341e2-0399-4820-a58a-412045e993c8 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058" status: 200 len: 1366 microversion: 2.1 time: 0.335660 May 26 18:04:45.012301 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 221/480] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:44 2022] GET /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058 => generated 1366 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:45.278075 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-0acd4cbd-4341-4b4c-a4a6-7e1f35363a53 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:45.279306 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-0acd4cbd-4341-4b4c-a4a6-7e1f35363a53 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:45.290978 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0acd4cbd-4341-4b4c-a4a6-7e1f35363a53 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:45.291766 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0acd4cbd-4341-4b4c-a4a6-7e1f35363a53 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:45.293605 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0acd4cbd-4341-4b4c-a4a6-7e1f35363a53 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:45.294396 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0acd4cbd-4341-4b4c-a4a6-7e1f35363a53 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:45.545367 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-0acd4cbd-4341-4b4c-a4a6-7e1f35363a53 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:45.549209 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_cell1:SELECT=100 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:04:45.560580 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-0acd4cbd-4341-4b4c-a4a6-7e1f35363a53 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1271 microversion: 2.1 time: 0.290406 May 26 18:04:45.561466 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 260/481] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:45 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1271 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:45.847772 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-a166f954-f426-415c-b030-01fdc467014f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:45.848475 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-a166f954-f426-415c-b030-01fdc467014f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:45.856649 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a166f954-f426-415c-b030-01fdc467014f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:45.857104 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a166f954-f426-415c-b030-01fdc467014f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:45.858009 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a166f954-f426-415c-b030-01fdc467014f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:45.858455 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a166f954-f426-415c-b030-01fdc467014f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:46.034242 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-011af450-b518-46a7-b2c3-d4c4a40383f2 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:46.035613 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-011af450-b518-46a7-b2c3-d4c4a40383f2 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 6bb99e9b-15af-408e-af01-6e08b8294058] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:46.048383 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-011af450-b518-46a7-b2c3-d4c4a40383f2 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:46.049181 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-011af450-b518-46a7-b2c3-d4c4a40383f2 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:46.050854 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-011af450-b518-46a7-b2c3-d4c4a40383f2 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:46.051640 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-011af450-b518-46a7-b2c3-d4c4a40383f2 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:46.118589 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-a166f954-f426-415c-b030-01fdc467014f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:46.135155 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-a166f954-f426-415c-b030-01fdc467014f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:46.137348 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-a166f954-f426-415c-b030-01fdc467014f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:46.138578 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-a166f954-f426-415c-b030-01fdc467014f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1808 microversion: 2.20 time: 0.294954 May 26 18:04:46.139160 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 222/482] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:04:45 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1808 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:04:46.231219 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-011af450-b518-46a7-b2c3-d4c4a40383f2 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:46.240189 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-011af450-b518-46a7-b2c3-d4c4a40383f2 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058" status: 200 len: 1366 microversion: 2.1 time: 0.212751 May 26 18:04:46.242116 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 261/483] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:46 2022] GET /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058 => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:46.580698 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-3e135fe9-f0d2-4ffd-add3-38a3f28967f9 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:46.581401 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-3e135fe9-f0d2-4ffd-add3-38a3f28967f9 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:46.588587 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3e135fe9-f0d2-4ffd-add3-38a3f28967f9 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:46.589346 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3e135fe9-f0d2-4ffd-add3-38a3f28967f9 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:46.590157 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3e135fe9-f0d2-4ffd-add3-38a3f28967f9 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:46.590595 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3e135fe9-f0d2-4ffd-add3-38a3f28967f9 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:46.768487 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-3e135fe9-f0d2-4ffd-add3-38a3f28967f9 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:46.777672 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-3e135fe9-f0d2-4ffd-add3-38a3f28967f9 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1259 microversion: 2.1 time: 0.201539 May 26 18:04:46.778289 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 223/484] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:46 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1259 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:04:47.168004 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-ac854437-ee5b-4199-b55d-56f2f763045b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:47.168872 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-ac854437-ee5b-4199-b55d-56f2f763045b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:47.175971 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ac854437-ee5b-4199-b55d-56f2f763045b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:47.176468 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ac854437-ee5b-4199-b55d-56f2f763045b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:47.177398 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ac854437-ee5b-4199-b55d-56f2f763045b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:47.177728 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ac854437-ee5b-4199-b55d-56f2f763045b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:47.264454 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-bcac8581-26a7-4cc7-bc0b-4b954ae79908 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:47.265643 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-bcac8581-26a7-4cc7-bc0b-4b954ae79908 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 6bb99e9b-15af-408e-af01-6e08b8294058] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:47.279461 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-bcac8581-26a7-4cc7-bc0b-4b954ae79908 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:47.280276 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-bcac8581-26a7-4cc7-bc0b-4b954ae79908 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:47.281713 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-bcac8581-26a7-4cc7-bc0b-4b954ae79908 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:47.282492 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-bcac8581-26a7-4cc7-bc0b-4b954ae79908 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:47.345942 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-ac854437-ee5b-4199-b55d-56f2f763045b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:47.357545 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-ac854437-ee5b-4199-b55d-56f2f763045b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:47.359527 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-ac854437-ee5b-4199-b55d-56f2f763045b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:47.360945 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-ac854437-ee5b-4199-b55d-56f2f763045b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1808 microversion: 2.20 time: 0.197728 May 26 18:04:47.361644 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 262/485] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:04:47 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1808 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:04:47.457546 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-bcac8581-26a7-4cc7-bc0b-4b954ae79908 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:47.466923 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-bcac8581-26a7-4cc7-bc0b-4b954ae79908 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058" status: 200 len: 1366 microversion: 2.1 time: 0.211847 May 26 18:04:47.467554 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 224/486] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:47 2022] GET /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058 => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:47.804978 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-ef7a9055-7d22-470c-8a33-b86a67b03d02 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:47.805727 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-ef7a9055-7d22-470c-8a33-b86a67b03d02 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:47.812965 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ef7a9055-7d22-470c-8a33-b86a67b03d02 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:47.813425 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ef7a9055-7d22-470c-8a33-b86a67b03d02 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:47.814230 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ef7a9055-7d22-470c-8a33-b86a67b03d02 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:47.814671 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ef7a9055-7d22-470c-8a33-b86a67b03d02 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:47.972000 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-ef7a9055-7d22-470c-8a33-b86a67b03d02 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:47.981145 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-ef7a9055-7d22-470c-8a33-b86a67b03d02 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1259 microversion: 2.1 time: 0.180323 May 26 18:04:47.981756 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 263/487] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:47 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1259 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:48.387100 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-57db2442-01b5-4f73-86d3-7b4f06b5952d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:48.387719 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-57db2442-01b5-4f73-86d3-7b4f06b5952d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:48.395883 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-57db2442-01b5-4f73-86d3-7b4f06b5952d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:48.396447 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-57db2442-01b5-4f73-86d3-7b4f06b5952d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:48.397684 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-57db2442-01b5-4f73-86d3-7b4f06b5952d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:48.398215 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-57db2442-01b5-4f73-86d3-7b4f06b5952d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:48.487223 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-f991a4d1-9b1a-43c3-ad19-cb24f0ea4de9 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:48.488825 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-f991a4d1-9b1a-43c3-ad19-cb24f0ea4de9 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 6bb99e9b-15af-408e-af01-6e08b8294058] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:48.500227 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-f991a4d1-9b1a-43c3-ad19-cb24f0ea4de9 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:48.500824 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-f991a4d1-9b1a-43c3-ad19-cb24f0ea4de9 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:48.501874 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-f991a4d1-9b1a-43c3-ad19-cb24f0ea4de9 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:48.502417 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-f991a4d1-9b1a-43c3-ad19-cb24f0ea4de9 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:48.568245 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-57db2442-01b5-4f73-86d3-7b4f06b5952d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:48.579677 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-57db2442-01b5-4f73-86d3-7b4f06b5952d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:48.581308 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-57db2442-01b5-4f73-86d3-7b4f06b5952d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:48.582695 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-57db2442-01b5-4f73-86d3-7b4f06b5952d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1808 microversion: 2.20 time: 0.200202 May 26 18:04:48.583289 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 225/488] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:04:48 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1808 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:04:48.675858 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-f991a4d1-9b1a-43c3-ad19-cb24f0ea4de9 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:48.684957 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-f991a4d1-9b1a-43c3-ad19-cb24f0ea4de9 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058" status: 200 len: 1366 microversion: 2.1 time: 0.201949 May 26 18:04:48.685563 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 264/489] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:48 2022] GET /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058 => generated 1366 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:04:49.000159 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-5f18bda6-b144-4e88-b7f4-620b08371134 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:49.000733 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-5f18bda6-b144-4e88-b7f4-620b08371134 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:49.007308 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5f18bda6-b144-4e88-b7f4-620b08371134 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:49.007798 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5f18bda6-b144-4e88-b7f4-620b08371134 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:49.008756 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5f18bda6-b144-4e88-b7f4-620b08371134 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:49.009239 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5f18bda6-b144-4e88-b7f4-620b08371134 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:49.279617 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-5f18bda6-b144-4e88-b7f4-620b08371134 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:49.288504 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-5f18bda6-b144-4e88-b7f4-620b08371134 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1259 microversion: 2.1 time: 0.292386 May 26 18:04:49.289117 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 226/490] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:48 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1259 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:49.608137 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-afaf32cb-2e41-4d4a-846a-0f994522590e tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:49.608878 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-afaf32cb-2e41-4d4a-846a-0f994522590e tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:49.616227 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-afaf32cb-2e41-4d4a-846a-0f994522590e tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:49.616854 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-afaf32cb-2e41-4d4a-846a-0f994522590e tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:49.617788 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-afaf32cb-2e41-4d4a-846a-0f994522590e tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:49.618303 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-afaf32cb-2e41-4d4a-846a-0f994522590e tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:49.704551 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-a86521d8-ffd4-4dd5-95b1-f5043bf13476 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:49.705757 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-a86521d8-ffd4-4dd5-95b1-f5043bf13476 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 6bb99e9b-15af-408e-af01-6e08b8294058] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:49.715896 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a86521d8-ffd4-4dd5-95b1-f5043bf13476 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:49.716849 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a86521d8-ffd4-4dd5-95b1-f5043bf13476 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:49.718101 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a86521d8-ffd4-4dd5-95b1-f5043bf13476 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:49.718982 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a86521d8-ffd4-4dd5-95b1-f5043bf13476 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:49.807112 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-afaf32cb-2e41-4d4a-846a-0f994522590e tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:49.818089 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-afaf32cb-2e41-4d4a-846a-0f994522590e tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:49.820423 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-afaf32cb-2e41-4d4a-846a-0f994522590e tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:49.821923 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-afaf32cb-2e41-4d4a-846a-0f994522590e tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1808 microversion: 2.20 time: 0.218077 May 26 18:04:49.824086 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 265/491] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:04:49 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1808 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:04:49.942454 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-a86521d8-ffd4-4dd5-95b1-f5043bf13476 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:49.953176 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-a86521d8-ffd4-4dd5-95b1-f5043bf13476 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058" status: 200 len: 1557 microversion: 2.1 time: 0.253853 May 26 18:04:49.954001 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 227/492] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:49 2022] GET /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058 => generated 1557 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:04:49.974349 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-8ac55f25-07ac-4f12-9cf8-9cd370a48fe9 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:49.975265 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-8ac55f25-07ac-4f12-9cf8-9cd370a48fe9 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 6bb99e9b-15af-408e-af01-6e08b8294058] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:49.985708 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-8ac55f25-07ac-4f12-9cf8-9cd370a48fe9 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:49.986384 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-8ac55f25-07ac-4f12-9cf8-9cd370a48fe9 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:49.987639 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-8ac55f25-07ac-4f12-9cf8-9cd370a48fe9 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:49.988189 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-8ac55f25-07ac-4f12-9cf8-9cd370a48fe9 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:50.110979 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-8ac55f25-07ac-4f12-9cf8-9cd370a48fe9 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.141450 May 26 18:04:50.113057 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 266/493] 10.222.0.69 () {58 vars in 1274 bytes} [Thu May 26 18:04:49 2022] GET /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058/os-interface => generated 285 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:04:50.307560 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-653183e2-58cb-4d8a-8fc1-c196e0893742 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:50.308441 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-653183e2-58cb-4d8a-8fc1-c196e0893742 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:50.315477 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-653183e2-58cb-4d8a-8fc1-c196e0893742 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:50.316000 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-653183e2-58cb-4d8a-8fc1-c196e0893742 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:50.316936 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-653183e2-58cb-4d8a-8fc1-c196e0893742 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:50.317450 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-653183e2-58cb-4d8a-8fc1-c196e0893742 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:50.511532 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-653183e2-58cb-4d8a-8fc1-c196e0893742 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:50.526929 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-653183e2-58cb-4d8a-8fc1-c196e0893742 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1259 microversion: 2.1 time: 0.222322 May 26 18:04:50.528172 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 228/494] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:50 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1259 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:50.854451 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-c38edcf9-b496-47e6-bb94-3b39d499fbab tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:50.855674 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-c38edcf9-b496-47e6-bb94-3b39d499fbab tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:50.866764 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c38edcf9-b496-47e6-bb94-3b39d499fbab tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:50.867405 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c38edcf9-b496-47e6-bb94-3b39d499fbab tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:50.868400 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c38edcf9-b496-47e6-bb94-3b39d499fbab tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:50.869163 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c38edcf9-b496-47e6-bb94-3b39d499fbab tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:51.110623 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-c38edcf9-b496-47e6-bb94-3b39d499fbab tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:51.124172 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-c38edcf9-b496-47e6-bb94-3b39d499fbab tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:51.125682 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-c38edcf9-b496-47e6-bb94-3b39d499fbab tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:51.127221 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-c38edcf9-b496-47e6-bb94-3b39d499fbab tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1808 microversion: 2.20 time: 0.280932 May 26 18:04:51.128405 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 267/495] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:04:50 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1808 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:04:51.424043 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-01d3100c-f7fd-401a-bdd9-e9e7dd116aeb req-d83f16f4-e357-4286-af9f-1cff21766521 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bb99e9b-15af-408e-af01-6e08b8294058", "tag": "0dd6e103-d470-44be-a25f-1cd6fdfa887e"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:04:51.435973 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-01d3100c-f7fd-401a-bdd9-e9e7dd116aeb req-d83f16f4-e357-4286-af9f-1cff21766521 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:51.436642 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-01d3100c-f7fd-401a-bdd9-e9e7dd116aeb req-d83f16f4-e357-4286-af9f-1cff21766521 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:51.451225 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-01d3100c-f7fd-401a-bdd9-e9e7dd116aeb req-d83f16f4-e357-4286-af9f-1cff21766521 service nova] Creating event network-changed:0dd6e103-d470-44be-a25f-1cd6fdfa887e for instance 6bb99e9b-15af-408e-af01-6e08b8294058 on hv-cinder-83607 May 26 18:04:51.457072 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-01d3100c-f7fd-401a-bdd9-e9e7dd116aeb req-d83f16f4-e357-4286-af9f-1cff21766521 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036753 May 26 18:04:51.457712 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 229/496] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:04:51.554752 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-563a2cb7-8138-48f2-9657-3ad33613ebd3 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:51.555482 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-563a2cb7-8138-48f2-9657-3ad33613ebd3 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:51.564255 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-563a2cb7-8138-48f2-9657-3ad33613ebd3 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:51.564888 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-563a2cb7-8138-48f2-9657-3ad33613ebd3 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:51.565956 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-563a2cb7-8138-48f2-9657-3ad33613ebd3 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:51.566583 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-563a2cb7-8138-48f2-9657-3ad33613ebd3 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:51.745240 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-563a2cb7-8138-48f2-9657-3ad33613ebd3 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:51.753852 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-563a2cb7-8138-48f2-9657-3ad33613ebd3 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1259 microversion: 2.1 time: 0.204299 May 26 18:04:51.754444 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 268/497] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:51 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1259 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:04:52.150683 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-f81e0626-033d-4de2-87b1-612723d764f9 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:52.151676 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-f81e0626-033d-4de2-87b1-612723d764f9 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:52.159351 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f81e0626-033d-4de2-87b1-612723d764f9 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:52.159958 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f81e0626-033d-4de2-87b1-612723d764f9 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:52.161120 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f81e0626-033d-4de2-87b1-612723d764f9 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:52.161697 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f81e0626-033d-4de2-87b1-612723d764f9 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:52.393051 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-f81e0626-033d-4de2-87b1-612723d764f9 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:52.403164 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-f81e0626-033d-4de2-87b1-612723d764f9 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:52.404744 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-f81e0626-033d-4de2-87b1-612723d764f9 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:52.405969 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-f81e0626-033d-4de2-87b1-612723d764f9 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1808 microversion: 2.20 time: 0.260863 May 26 18:04:52.406540 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 230/498] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:04:52 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1808 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:04:52.777391 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-b40e2335-fe09-4851-8d16-a5ed7dc1a574 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:52.778432 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-b40e2335-fe09-4851-8d16-a5ed7dc1a574 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:52.789932 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b40e2335-fe09-4851-8d16-a5ed7dc1a574 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:52.791225 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b40e2335-fe09-4851-8d16-a5ed7dc1a574 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:52.792613 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b40e2335-fe09-4851-8d16-a5ed7dc1a574 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:52.793357 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b40e2335-fe09-4851-8d16-a5ed7dc1a574 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:52.965940 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-b40e2335-fe09-4851-8d16-a5ed7dc1a574 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:52.974756 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-b40e2335-fe09-4851-8d16-a5ed7dc1a574 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1259 microversion: 2.1 time: 0.202328 May 26 18:04:52.975413 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 269/499] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:52 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1259 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:53.426454 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-10961f8b-aaea-47de-a218-2898fc729c5d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:53.427138 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-10961f8b-aaea-47de-a218-2898fc729c5d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:53.435179 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-10961f8b-aaea-47de-a218-2898fc729c5d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:53.435636 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-10961f8b-aaea-47de-a218-2898fc729c5d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:53.436491 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-10961f8b-aaea-47de-a218-2898fc729c5d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:53.436931 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-10961f8b-aaea-47de-a218-2898fc729c5d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:53.602507 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-10961f8b-aaea-47de-a218-2898fc729c5d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:53.619390 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-10961f8b-aaea-47de-a218-2898fc729c5d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:53.622507 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-10961f8b-aaea-47de-a218-2898fc729c5d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:53.624874 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-10961f8b-aaea-47de-a218-2898fc729c5d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1808 microversion: 2.20 time: 0.202247 May 26 18:04:53.625893 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 231/500] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:04:53 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1808 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:53.992778 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-b92aea53-b241-4b74-afba-e84f958352f6 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:53.993564 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-b92aea53-b241-4b74-afba-e84f958352f6 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:54.001518 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b92aea53-b241-4b74-afba-e84f958352f6 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:54.001980 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b92aea53-b241-4b74-afba-e84f958352f6 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:54.002782 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b92aea53-b241-4b74-afba-e84f958352f6 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:54.003262 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b92aea53-b241-4b74-afba-e84f958352f6 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:54.158670 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-b92aea53-b241-4b74-afba-e84f958352f6 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:54.172684 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-b92aea53-b241-4b74-afba-e84f958352f6 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1259 microversion: 2.1 time: 0.183316 May 26 18:04:54.173623 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 270/501] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:53 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1259 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:04:54.655451 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-45cf8eb8-78e3-40cb-b171-ce69f410a439 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:54.656301 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-45cf8eb8-78e3-40cb-b171-ce69f410a439 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:54.664647 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-45cf8eb8-78e3-40cb-b171-ce69f410a439 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:54.665212 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-45cf8eb8-78e3-40cb-b171-ce69f410a439 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:54.666839 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-45cf8eb8-78e3-40cb-b171-ce69f410a439 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:54.667582 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-45cf8eb8-78e3-40cb-b171-ce69f410a439 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:54.922530 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-45cf8eb8-78e3-40cb-b171-ce69f410a439 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:54.934639 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-45cf8eb8-78e3-40cb-b171-ce69f410a439 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:54.936490 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-45cf8eb8-78e3-40cb-b171-ce69f410a439 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:54.938102 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-45cf8eb8-78e3-40cb-b171-ce69f410a439 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1808 microversion: 2.20 time: 0.288078 May 26 18:04:54.938897 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 232/502] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:04:54 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1808 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:04:55.199674 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-0a195dc5-a455-40d3-aa7c-16f98af880a9 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:55.200436 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-0a195dc5-a455-40d3-aa7c-16f98af880a9 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:55.207630 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0a195dc5-a455-40d3-aa7c-16f98af880a9 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:55.208164 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0a195dc5-a455-40d3-aa7c-16f98af880a9 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:55.208976 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0a195dc5-a455-40d3-aa7c-16f98af880a9 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:55.209421 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0a195dc5-a455-40d3-aa7c-16f98af880a9 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:55.379825 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-0a195dc5-a455-40d3-aa7c-16f98af880a9 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:55.389714 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-0a195dc5-a455-40d3-aa7c-16f98af880a9 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1259 microversion: 2.1 time: 0.194808 May 26 18:04:55.390324 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 271/503] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:55 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1259 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:55.958891 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-293c6033-6b27-4adf-979e-0464109cd378 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:55.959519 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-293c6033-6b27-4adf-979e-0464109cd378 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:55.967589 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-293c6033-6b27-4adf-979e-0464109cd378 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:55.968073 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-293c6033-6b27-4adf-979e-0464109cd378 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:55.968886 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-293c6033-6b27-4adf-979e-0464109cd378 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:55.969327 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-293c6033-6b27-4adf-979e-0464109cd378 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:56.354067 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-293c6033-6b27-4adf-979e-0464109cd378 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:56.365943 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-293c6033-6b27-4adf-979e-0464109cd378 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:56.367921 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-293c6033-6b27-4adf-979e-0464109cd378 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:56.369609 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-293c6033-6b27-4adf-979e-0464109cd378 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1808 microversion: 2.20 time: 0.414746 May 26 18:04:56.370639 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 233/504] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:04:55 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1808 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:56.408799 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-d8ecadc0-7eb9-4650-b682-3a102041a913 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:56.409867 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-d8ecadc0-7eb9-4650-b682-3a102041a913 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:56.412795 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:04:56.421076 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d8ecadc0-7eb9-4650-b682-3a102041a913 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:56.421719 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d8ecadc0-7eb9-4650-b682-3a102041a913 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:56.422801 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d8ecadc0-7eb9-4650-b682-3a102041a913 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:56.423400 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d8ecadc0-7eb9-4650-b682-3a102041a913 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:56.591539 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-d8ecadc0-7eb9-4650-b682-3a102041a913 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:56.602380 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-d8ecadc0-7eb9-4650-b682-3a102041a913 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1259 microversion: 2.1 time: 0.197731 May 26 18:04:56.603399 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 272/505] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:56 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1259 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:04:57.397758 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-6611659b-ed8c-41df-991d-539cf4a0595c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:57.398475 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-6611659b-ed8c-41df-991d-539cf4a0595c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:57.407251 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6611659b-ed8c-41df-991d-539cf4a0595c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:57.407887 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6611659b-ed8c-41df-991d-539cf4a0595c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:57.409253 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6611659b-ed8c-41df-991d-539cf4a0595c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:57.409779 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6611659b-ed8c-41df-991d-539cf4a0595c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:57.587017 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-6611659b-ed8c-41df-991d-539cf4a0595c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:57.596903 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-6611659b-ed8c-41df-991d-539cf4a0595c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:57.598454 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-6611659b-ed8c-41df-991d-539cf4a0595c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:57.599672 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-6611659b-ed8c-41df-991d-539cf4a0595c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1808 microversion: 2.20 time: 0.206380 May 26 18:04:57.600395 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 234/506] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:04:57 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1808 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:04:57.624829 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-d5da2b66-644e-4634-b032-0e8245aae003 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:57.625570 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-d5da2b66-644e-4634-b032-0e8245aae003 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:57.632962 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d5da2b66-644e-4634-b032-0e8245aae003 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:57.633473 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d5da2b66-644e-4634-b032-0e8245aae003 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:57.634907 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d5da2b66-644e-4634-b032-0e8245aae003 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:57.635378 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d5da2b66-644e-4634-b032-0e8245aae003 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:57.785211 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-d1045ec5-ddff-43ec-a0fb-3b781309df4d tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:57.785714 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-d1045ec5-ddff-43ec-a0fb-3b781309df4d tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] [instance: c390424a-1a68-4b4f-abea-917428ba36e5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:57.792230 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d1045ec5-ddff-43ec-a0fb-3b781309df4d tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:57.792681 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d1045ec5-ddff-43ec-a0fb-3b781309df4d tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:57.793514 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d1045ec5-ddff-43ec-a0fb-3b781309df4d tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:57.793963 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d1045ec5-ddff-43ec-a0fb-3b781309df4d tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:57.805430 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-d5da2b66-644e-4634-b032-0e8245aae003 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:57.814204 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-d5da2b66-644e-4634-b032-0e8245aae003 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1259 microversion: 2.1 time: 0.193516 May 26 18:04:57.814843 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 273/507] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:57 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1259 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:57.883894 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.objects.instance [None req-d1045ec5-ddff-43ec-a0fb-3b781309df4d tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lazy-loading 'services' on Instance uuid c390424a-1a68-4b4f-abea-917428ba36e5 {{(pid=117723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:04:57.888784 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=100 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:04:57.968109 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-d1045ec5-ddff-43ec-a0fb-3b781309df4d tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] 10.222.0.69 "DELETE /compute/v2.1/servers/c390424a-1a68-4b4f-abea-917428ba36e5/os-volume_attachments/6c260889-1545-4df0-a330-3eb841d46c47" status: 202 len: 0 microversion: 2.1 time: 0.186570 May 26 18:04:57.968823 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 235/508] 10.222.0.69 () {58 vars in 1415 bytes} [Thu May 26 18:04:57 2022] DELETE /compute/v2.1/servers/c390424a-1a68-4b4f-abea-917428ba36e5/os-volume_attachments/6c260889-1545-4df0-a330-3eb841d46c47 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:04:58.550076 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [req-b4da4c30-a9a4-4992-bac1-4bad3d1e63d8 req-2a2ef6aa-1637-4c26-b246-e06cd3a98dbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "262a4944-6c10-4122-adce-f7780ff4e7a1", "name": "network-vif-plugged", "status": "completed", "tag": "0450cfd2-c365-4788-a3b6-a839770208e7"}]} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:04:58.559397 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-b4da4c30-a9a4-4992-bac1-4bad3d1e63d8 req-2a2ef6aa-1637-4c26-b246-e06cd3a98dbb service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:58.559896 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-b4da4c30-a9a4-4992-bac1-4bad3d1e63d8 req-2a2ef6aa-1637-4c26-b246-e06cd3a98dbb service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:58.573258 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.compute.server_external_events [req-b4da4c30-a9a4-4992-bac1-4bad3d1e63d8 req-2a2ef6aa-1637-4c26-b246-e06cd3a98dbb service nova] Creating event network-vif-plugged:0450cfd2-c365-4788-a3b6-a839770208e7 for instance 262a4944-6c10-4122-adce-f7780ff4e7a1 on hv-cinder-83607 May 26 18:04:58.579054 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [req-b4da4c30-a9a4-4992-bac1-4bad3d1e63d8 req-2a2ef6aa-1637-4c26-b246-e06cd3a98dbb service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032522 May 26 18:04:58.579905 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 274/509] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:04:58.626157 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-4722cbff-d91e-4ae9-a0f3-0bf4bed9c692 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:58.627810 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-4722cbff-d91e-4ae9-a0f3-0bf4bed9c692 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:58.640439 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4722cbff-d91e-4ae9-a0f3-0bf4bed9c692 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:58.641413 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4722cbff-d91e-4ae9-a0f3-0bf4bed9c692 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:58.642739 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4722cbff-d91e-4ae9-a0f3-0bf4bed9c692 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:58.643527 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4722cbff-d91e-4ae9-a0f3-0bf4bed9c692 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:58.800675 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-4722cbff-d91e-4ae9-a0f3-0bf4bed9c692 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:58.810922 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-4722cbff-d91e-4ae9-a0f3-0bf4bed9c692 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:58.812545 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-4722cbff-d91e-4ae9-a0f3-0bf4bed9c692 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:58.813785 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-4722cbff-d91e-4ae9-a0f3-0bf4bed9c692 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1808 microversion: 2.20 time: 0.198140 May 26 18:04:58.814369 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 236/510] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:04:58 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1808 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:58.833871 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-8d452db3-58ff-4bb0-b693-60483076fffd tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:58.834583 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-8d452db3-58ff-4bb0-b693-60483076fffd tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:58.841732 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-8d452db3-58ff-4bb0-b693-60483076fffd tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:58.842187 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-8d452db3-58ff-4bb0-b693-60483076fffd tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:58.842988 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-8d452db3-58ff-4bb0-b693-60483076fffd tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:58.843435 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-8d452db3-58ff-4bb0-b693-60483076fffd tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:58.991845 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-8d452db3-58ff-4bb0-b693-60483076fffd tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:59.001059 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-8d452db3-58ff-4bb0-b693-60483076fffd tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1259 microversion: 2.1 time: 0.171960 May 26 18:04:59.001658 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 275/511] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:04:58 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1259 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:04:59.833601 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-140bf292-c546-4c23-be3a-fc2061ef16b3 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:59.834576 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-140bf292-c546-4c23-be3a-fc2061ef16b3 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:59.838168 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_api:SELECT=70 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:04:59.844930 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-140bf292-c546-4c23-be3a-fc2061ef16b3 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:59.845384 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-140bf292-c546-4c23-be3a-fc2061ef16b3 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:59.846185 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-140bf292-c546-4c23-be3a-fc2061ef16b3 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:59.846625 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-140bf292-c546-4c23-be3a-fc2061ef16b3 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:00.011330 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-140bf292-c546-4c23-be3a-fc2061ef16b3 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:00.019620 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-e93fcbef-c3e9-4155-8df1-296e4ddcc29e tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:00.020657 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-e93fcbef-c3e9-4155-8df1-296e4ddcc29e tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:00.021729 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-140bf292-c546-4c23-be3a-fc2061ef16b3 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:00.023400 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-140bf292-c546-4c23-be3a-fc2061ef16b3 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:00.025547 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-140bf292-c546-4c23-be3a-fc2061ef16b3 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1808 microversion: 2.20 time: 0.195308 May 26 18:05:00.026254 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 237/512] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:04:59 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1808 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:05:00.032493 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e93fcbef-c3e9-4155-8df1-296e4ddcc29e tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:00.033372 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e93fcbef-c3e9-4155-8df1-296e4ddcc29e tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:00.034898 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e93fcbef-c3e9-4155-8df1-296e4ddcc29e tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:00.035806 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e93fcbef-c3e9-4155-8df1-296e4ddcc29e tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:00.215789 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-e93fcbef-c3e9-4155-8df1-296e4ddcc29e tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:00.217722 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-7251b411-809a-4e1e-9ee1-3871b793f6c1 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:00.218983 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-7251b411-809a-4e1e-9ee1-3871b793f6c1 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] [instance: c390424a-1a68-4b4f-abea-917428ba36e5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:00.225373 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-e93fcbef-c3e9-4155-8df1-296e4ddcc29e tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1259 microversion: 2.1 time: 0.210103 May 26 18:05:00.226077 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7251b411-809a-4e1e-9ee1-3871b793f6c1 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:00.226510 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 276/513] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:05:00 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1259 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:05:00.226845 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7251b411-809a-4e1e-9ee1-3871b793f6c1 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:00.228178 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7251b411-809a-4e1e-9ee1-3871b793f6c1 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:00.228631 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7251b411-809a-4e1e-9ee1-3871b793f6c1 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:00.260453 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-7251b411-809a-4e1e-9ee1-3871b793f6c1 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] [instance: c390424a-1a68-4b4f-abea-917428ba36e5] Going to try to terminate instance {{(pid=117723) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:05:00.358995 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-7251b411-809a-4e1e-9ee1-3871b793f6c1 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] 10.222.0.69 "DELETE /compute/v2.1/servers/c390424a-1a68-4b4f-abea-917428ba36e5" status: 204 len: 0 microversion: 2.1 time: 0.145357 May 26 18:05:00.359536 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 238/514] 10.222.0.69 () {58 vars in 1238 bytes} [Thu May 26 18:05:00 2022] DELETE /compute/v2.1/servers/c390424a-1a68-4b4f-abea-917428ba36e5 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 26 18:05:00.368957 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-fb3f4bcb-78a4-4b33-85ad-99485ddc695e tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:00.369743 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-fb3f4bcb-78a4-4b33-85ad-99485ddc695e tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] [instance: c390424a-1a68-4b4f-abea-917428ba36e5] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:00.377055 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-fb3f4bcb-78a4-4b33-85ad-99485ddc695e tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:00.377583 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-fb3f4bcb-78a4-4b33-85ad-99485ddc695e tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:00.378422 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-fb3f4bcb-78a4-4b33-85ad-99485ddc695e tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:00.378936 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-fb3f4bcb-78a4-4b33-85ad-99485ddc695e tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:00.531057 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-fb3f4bcb-78a4-4b33-85ad-99485ddc695e tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b8f37c287341848d8d3b4d5f62873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fdf6152e6874f78825e5eddb7f14158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:00.540128 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-fb3f4bcb-78a4-4b33-85ad-99485ddc695e tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] 10.222.0.69 "GET /compute/v2.1/servers/c390424a-1a68-4b4f-abea-917428ba36e5" status: 200 len: 1560 microversion: 2.1 time: 0.175395 May 26 18:05:00.540759 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 277/515] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:05:00 2022] GET /compute/v2.1/servers/c390424a-1a68-4b4f-abea-917428ba36e5 => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:05:01.045647 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-6d1510b8-a86c-469d-bbf5-a9fa6f434aae tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:01.046443 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-6d1510b8-a86c-469d-bbf5-a9fa6f434aae tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:01.053967 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6d1510b8-a86c-469d-bbf5-a9fa6f434aae tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:01.054497 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6d1510b8-a86c-469d-bbf5-a9fa6f434aae tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:01.055379 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6d1510b8-a86c-469d-bbf5-a9fa6f434aae tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:01.056457 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6d1510b8-a86c-469d-bbf5-a9fa6f434aae tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:01.245104 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-47bc634a-1cbc-4ac6-9ef6-be937b9c7773 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:01.246944 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-47bc634a-1cbc-4ac6-9ef6-be937b9c7773 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:01.254991 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-6d1510b8-a86c-469d-bbf5-a9fa6f434aae tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:01.257370 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-47bc634a-1cbc-4ac6-9ef6-be937b9c7773 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:01.258133 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-47bc634a-1cbc-4ac6-9ef6-be937b9c7773 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:01.259535 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-47bc634a-1cbc-4ac6-9ef6-be937b9c7773 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:01.260331 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-47bc634a-1cbc-4ac6-9ef6-be937b9c7773 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:01.270447 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-6d1510b8-a86c-469d-bbf5-a9fa6f434aae tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:01.273737 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-6d1510b8-a86c-469d-bbf5-a9fa6f434aae tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:01.277185 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-6d1510b8-a86c-469d-bbf5-a9fa6f434aae tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1808 microversion: 2.20 time: 0.235879 May 26 18:05:01.278177 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 239/516] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:05:01 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1808 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:05:01.291169 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_cell1:SELECT=100 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:05:01.458996 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-47bc634a-1cbc-4ac6-9ef6-be937b9c7773 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:01.467866 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-47bc634a-1cbc-4ac6-9ef6-be937b9c7773 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1259 microversion: 2.1 time: 0.226933 May 26 18:05:01.468645 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 278/517] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:05:01 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1259 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:05:01.559082 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-c558a2e4-9828-4097-8899-ca10634e4ef0 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:01.559761 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-c558a2e4-9828-4097-8899-ca10634e4ef0 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] [instance: c390424a-1a68-4b4f-abea-917428ba36e5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:01.566606 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c558a2e4-9828-4097-8899-ca10634e4ef0 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:01.567061 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c558a2e4-9828-4097-8899-ca10634e4ef0 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:01.567853 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c558a2e4-9828-4097-8899-ca10634e4ef0 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:01.568336 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c558a2e4-9828-4097-8899-ca10634e4ef0 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:01.725146 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-c558a2e4-9828-4097-8899-ca10634e4ef0 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b8f37c287341848d8d3b4d5f62873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fdf6152e6874f78825e5eddb7f14158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:01.734674 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-c558a2e4-9828-4097-8899-ca10634e4ef0 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] 10.222.0.69 "GET /compute/v2.1/servers/c390424a-1a68-4b4f-abea-917428ba36e5" status: 200 len: 1514 microversion: 2.1 time: 0.179498 May 26 18:05:01.735367 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 240/518] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:05:01 2022] GET /compute/v2.1/servers/c390424a-1a68-4b4f-abea-917428ba36e5 => generated 1514 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:02.308309 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-66749bb2-9062-4dd7-939c-6c9f800eea8b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:02.309235 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-66749bb2-9062-4dd7-939c-6c9f800eea8b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:02.316726 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-66749bb2-9062-4dd7-939c-6c9f800eea8b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:02.317181 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-66749bb2-9062-4dd7-939c-6c9f800eea8b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:02.318027 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-66749bb2-9062-4dd7-939c-6c9f800eea8b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:02.318465 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-66749bb2-9062-4dd7-939c-6c9f800eea8b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:02.487650 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-9371c258-a814-4d9a-a939-8320655b7237 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:02.489274 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-9371c258-a814-4d9a-a939-8320655b7237 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:02.501358 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-66749bb2-9062-4dd7-939c-6c9f800eea8b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:02.504365 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9371c258-a814-4d9a-a939-8320655b7237 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:02.505492 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9371c258-a814-4d9a-a939-8320655b7237 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:02.506869 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9371c258-a814-4d9a-a939-8320655b7237 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:02.507579 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9371c258-a814-4d9a-a939-8320655b7237 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:02.517976 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-66749bb2-9062-4dd7-939c-6c9f800eea8b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:02.521308 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-66749bb2-9062-4dd7-939c-6c9f800eea8b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:02.523437 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-66749bb2-9062-4dd7-939c-6c9f800eea8b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1808 microversion: 2.20 time: 0.219681 May 26 18:05:02.526856 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 279/519] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:05:02 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1808 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:05:02.730358 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-9371c258-a814-4d9a-a939-8320655b7237 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:02.738747 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-9371c258-a814-4d9a-a939-8320655b7237 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1259 microversion: 2.1 time: 0.256713 May 26 18:05:02.739351 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 241/520] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:05:02 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1259 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:05:02.755539 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-e11ac1ee-7c04-4242-98d4-e83f754070dc tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:02.756569 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-e11ac1ee-7c04-4242-98d4-e83f754070dc tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] [instance: c390424a-1a68-4b4f-abea-917428ba36e5] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:02.765929 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e11ac1ee-7c04-4242-98d4-e83f754070dc tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:02.766426 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e11ac1ee-7c04-4242-98d4-e83f754070dc tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:02.767364 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e11ac1ee-7c04-4242-98d4-e83f754070dc tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:02.767872 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e11ac1ee-7c04-4242-98d4-e83f754070dc tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:02.926604 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-e11ac1ee-7c04-4242-98d4-e83f754070dc tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b8f37c287341848d8d3b4d5f62873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fdf6152e6874f78825e5eddb7f14158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:02.936497 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-e11ac1ee-7c04-4242-98d4-e83f754070dc tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] 10.222.0.69 "GET /compute/v2.1/servers/c390424a-1a68-4b4f-abea-917428ba36e5" status: 200 len: 1514 microversion: 2.1 time: 0.186910 May 26 18:05:02.937108 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 280/521] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:05:02 2022] GET /compute/v2.1/servers/c390424a-1a68-4b4f-abea-917428ba36e5 => generated 1514 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:03.554581 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-2b8b7ab0-df38-42c6-be13-76707213d789 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:03.555348 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-2b8b7ab0-df38-42c6-be13-76707213d789 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:03.566671 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2b8b7ab0-df38-42c6-be13-76707213d789 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:03.567180 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2b8b7ab0-df38-42c6-be13-76707213d789 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:03.567851 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2b8b7ab0-df38-42c6-be13-76707213d789 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:03.569617 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2b8b7ab0-df38-42c6-be13-76707213d789 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:03.758128 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-b2418654-d1cf-46eb-acf1-92d4d5d12195 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:03.760094 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-b2418654-d1cf-46eb-acf1-92d4d5d12195 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:03.771544 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b2418654-d1cf-46eb-acf1-92d4d5d12195 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:03.774024 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b2418654-d1cf-46eb-acf1-92d4d5d12195 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:03.778129 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b2418654-d1cf-46eb-acf1-92d4d5d12195 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:03.779229 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b2418654-d1cf-46eb-acf1-92d4d5d12195 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:03.791694 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-2b8b7ab0-df38-42c6-be13-76707213d789 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:03.807905 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-2b8b7ab0-df38-42c6-be13-76707213d789 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:03.810948 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-2b8b7ab0-df38-42c6-be13-76707213d789 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:03.813075 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-2b8b7ab0-df38-42c6-be13-76707213d789 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1808 microversion: 2.20 time: 0.263241 May 26 18:05:03.814027 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 242/522] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:05:03 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1808 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:05:03.956087 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-0b6366d9-5e03-4895-893a-34eff368e691 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:03.956691 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-0b6366d9-5e03-4895-893a-34eff368e691 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] [instance: c390424a-1a68-4b4f-abea-917428ba36e5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:03.965042 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0b6366d9-5e03-4895-893a-34eff368e691 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:03.965946 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0b6366d9-5e03-4895-893a-34eff368e691 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:03.966976 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0b6366d9-5e03-4895-893a-34eff368e691 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:03.967587 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0b6366d9-5e03-4895-893a-34eff368e691 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:04.010263 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-b2418654-d1cf-46eb-acf1-92d4d5d12195 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:04.025458 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-b2418654-d1cf-46eb-acf1-92d4d5d12195 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1259 microversion: 2.1 time: 0.272613 May 26 18:05:04.040590 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 281/523] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:05:03 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1259 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:05:04.277552 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-0b6366d9-5e03-4895-893a-34eff368e691 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b8f37c287341848d8d3b4d5f62873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fdf6152e6874f78825e5eddb7f14158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:04.294353 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-0b6366d9-5e03-4895-893a-34eff368e691 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] 10.222.0.69 "GET /compute/v2.1/servers/c390424a-1a68-4b4f-abea-917428ba36e5" status: 200 len: 1514 microversion: 2.1 time: 0.341729 May 26 18:05:04.295550 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 243/524] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:05:03 2022] GET /compute/v2.1/servers/c390424a-1a68-4b4f-abea-917428ba36e5 => generated 1514 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:04.616969 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [req-e73d06af-a0ba-43b9-aa82-686bcd614c9c req-d6edcb46-9378-4842-ab75-16e4f9444f1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e417922-03b2-40d5-814a-4303948ed31b", "name": "network-vif-plugged", "status": "completed", "tag": "971e49f3-13e4-4d71-a577-21b1d36cef54"}]} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:05:04.628086 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-e73d06af-a0ba-43b9-aa82-686bcd614c9c req-d6edcb46-9378-4842-ab75-16e4f9444f1f service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:04.628637 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-e73d06af-a0ba-43b9-aa82-686bcd614c9c req-d6edcb46-9378-4842-ab75-16e4f9444f1f service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:04.644312 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.compute.server_external_events [req-e73d06af-a0ba-43b9-aa82-686bcd614c9c req-d6edcb46-9378-4842-ab75-16e4f9444f1f service nova] Creating event network-vif-plugged:971e49f3-13e4-4d71-a577-21b1d36cef54 for instance 8e417922-03b2-40d5-814a-4303948ed31b on hv-cinder-83607 May 26 18:05:04.651486 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [req-e73d06af-a0ba-43b9-aa82-686bcd614c9c req-d6edcb46-9378-4842-ab75-16e4f9444f1f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037568 May 26 18:05:04.652669 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 282/525] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:05:04.690337 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-0f72f659-041e-4ac4-9550-a7adfb4f3271 req-00f3410a-6c3f-4d5a-acb1-d4e69ac8bf3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c390424a-1a68-4b4f-abea-917428ba36e5", "name": "network-vif-deleted", "tag": "b554fe83-95b4-4b42-aeea-6e2f977bb086"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:05:04.711470 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-0f72f659-041e-4ac4-9550-a7adfb4f3271 req-00f3410a-6c3f-4d5a-acb1-d4e69ac8bf3c service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:04.712893 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-0f72f659-041e-4ac4-9550-a7adfb4f3271 req-00f3410a-6c3f-4d5a-acb1-d4e69ac8bf3c service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:04.740046 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-0f72f659-041e-4ac4-9550-a7adfb4f3271 req-00f3410a-6c3f-4d5a-acb1-d4e69ac8bf3c service nova] Creating event network-vif-deleted:b554fe83-95b4-4b42-aeea-6e2f977bb086 for instance c390424a-1a68-4b4f-abea-917428ba36e5 on hv-cinder-83607 May 26 18:05:04.749418 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-0f72f659-041e-4ac4-9550-a7adfb4f3271 req-00f3410a-6c3f-4d5a-acb1-d4e69ac8bf3c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065660 May 26 18:05:04.750843 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 244/526] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:05:04.844813 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-2f61b9d2-ccec-4344-bd38-71c325bf8969 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:04.845992 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-2f61b9d2-ccec-4344-bd38-71c325bf8969 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:04.858385 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-2f61b9d2-ccec-4344-bd38-71c325bf8969 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:04.859293 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-2f61b9d2-ccec-4344-bd38-71c325bf8969 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:04.860855 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-2f61b9d2-ccec-4344-bd38-71c325bf8969 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:04.861782 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-2f61b9d2-ccec-4344-bd38-71c325bf8969 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:05.051240 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-2f61b9d2-ccec-4344-bd38-71c325bf8969 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:05.058316 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-8e04ead7-2a77-4aae-87ad-d627290ac1c8 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:05.060172 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-8e04ead7-2a77-4aae-87ad-d627290ac1c8 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:05.063254 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-2f61b9d2-ccec-4344-bd38-71c325bf8969 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:05.064913 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-2f61b9d2-ccec-4344-bd38-71c325bf8969 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:05.066480 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-2f61b9d2-ccec-4344-bd38-71c325bf8969 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1795 microversion: 2.20 time: 0.231483 May 26 18:05:05.067293 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 283/527] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:05:04 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1795 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:05:05.074697 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8e04ead7-2a77-4aae-87ad-d627290ac1c8 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:05.076000 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8e04ead7-2a77-4aae-87ad-d627290ac1c8 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:05.077974 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8e04ead7-2a77-4aae-87ad-d627290ac1c8 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:05.079128 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8e04ead7-2a77-4aae-87ad-d627290ac1c8 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:05.267921 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-8e04ead7-2a77-4aae-87ad-d627290ac1c8 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:05.276928 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-8e04ead7-2a77-4aae-87ad-d627290ac1c8 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1259 microversion: 2.1 time: 0.227828 May 26 18:05:05.277545 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 245/528] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:05:05 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1259 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:05:05.317802 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-114ad639-4a7b-4c93-b81d-e793c7030269 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:05.318998 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-114ad639-4a7b-4c93-b81d-e793c7030269 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] [instance: c390424a-1a68-4b4f-abea-917428ba36e5] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:05.330643 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-114ad639-4a7b-4c93-b81d-e793c7030269 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:05.331481 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-114ad639-4a7b-4c93-b81d-e793c7030269 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:05.332869 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-114ad639-4a7b-4c93-b81d-e793c7030269 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:05.333614 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-114ad639-4a7b-4c93-b81d-e793c7030269 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:05.396883 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-114ad639-4a7b-4c93-b81d-e793c7030269 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:05.397602 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-114ad639-4a7b-4c93-b81d-e793c7030269 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:05.398386 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.objects.instance [None req-114ad639-4a7b-4c93-b81d-e793c7030269 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lazy-loading 'fault' on Instance uuid c390424a-1a68-4b4f-abea-917428ba36e5 {{(pid=117722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:05:05.445699 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-114ad639-4a7b-4c93-b81d-e793c7030269 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b8f37c287341848d8d3b4d5f62873d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fdf6152e6874f78825e5eddb7f14158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:05.455138 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-114ad639-4a7b-4c93-b81d-e793c7030269 tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] 10.222.0.69 "GET /compute/v2.1/servers/c390424a-1a68-4b4f-abea-917428ba36e5" status: 200 len: 1308 microversion: 2.1 time: 0.144728 May 26 18:05:05.455843 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 284/529] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:05:05 2022] GET /compute/v2.1/servers/c390424a-1a68-4b4f-abea-917428ba36e5 => generated 1308 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:06.295035 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-8891ad46-27a3-4250-ad5b-514827509029 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:06.295711 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-8891ad46-27a3-4250-ad5b-514827509029 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:06.304387 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8891ad46-27a3-4250-ad5b-514827509029 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:06.304962 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8891ad46-27a3-4250-ad5b-514827509029 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:06.306518 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8891ad46-27a3-4250-ad5b-514827509029 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:06.306966 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8891ad46-27a3-4250-ad5b-514827509029 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:06.468768 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-8891ad46-27a3-4250-ad5b-514827509029 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:06.475632 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-d577d9c8-51e8-4c77-9c2d-aece0f02c49f tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:06.477088 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-d577d9c8-51e8-4c77-9c2d-aece0f02c49f tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] [instance: c390424a-1a68-4b4f-abea-917428ba36e5] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:06.478417 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-8891ad46-27a3-4250-ad5b-514827509029 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1259 microversion: 2.1 time: 0.187717 May 26 18:05:06.479229 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 246/530] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:05:06 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1259 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:06.489500 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d577d9c8-51e8-4c77-9c2d-aece0f02c49f tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:06.490308 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d577d9c8-51e8-4c77-9c2d-aece0f02c49f tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:06.491739 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d577d9c8-51e8-4c77-9c2d-aece0f02c49f tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:06.492564 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d577d9c8-51e8-4c77-9c2d-aece0f02c49f tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:06.511636 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.wsgi [None req-d577d9c8-51e8-4c77-9c2d-aece0f02c49f tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] HTTP exception thrown: Instance c390424a-1a68-4b4f-abea-917428ba36e5 could not be found. May 26 18:05:06.513492 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-d577d9c8-51e8-4c77-9c2d-aece0f02c49f tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Request method failure captured: May 26 18:05:06.513492 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: request: GET /compute/v2.1/servers/c390424a-1a68-4b4f-abea-917428ba36e5 HTTP/1.1 May 26 18:05:06.513492 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Accept: application/json May 26 18:05:06.513492 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Accept-Encoding: identity May 26 18:05:06.513492 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Connection: close May 26 18:05:06.513492 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Content-Length: 0 May 26 18:05:06.513492 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Content-Type: application/json May 26 18:05:06.513492 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Host: 10.222.0.69 May 26 18:05:06.513492 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Openstack-System-Scope: None May 26 18:05:06.513492 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: User-Agent: python-urllib3/1.26.9 May 26 18:05:06.513492 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Auth-Token: gAAAAABij8C_eJ1QYUFkI8nLGOhiJpe-o8_DiPshgLiUa7rTfNnYfBmurfpJGxclb5lZAQEboaF2pfL2UXjGM1Y-PMtrcUO67XjqvYY_PC_RfGInVC1fZuyq6H-eV5ztMD5W96EeseUHtGJOUMhAHCXf-QkuUeCUV2WnBFlI6yrpQtKs2JUPv18 May 26 18:05:06.513492 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Domain-Id: None May 26 18:05:06.513492 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Domain-Name: None May 26 18:05:06.513492 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Identity-Status: Confirmed May 26 18:05:06.513492 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Is-Admin-Project: True May 26 18:05:06.513492 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Domain-Id: default May 26 18:05:06.513492 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Domain-Name: Default May 26 18:05:06.513492 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Id: 9fdf6152e6874f78825e5eddb7f14158 May 26 18:05:06.513492 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Name: tempest-VolumesSnapshotTestJSON-158119209 May 26 18:05:06.513492 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Role: member,reader May 26 18:05:06.513492 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Roles: member,reader May 26 18:05:06.516206 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9fdf6152e6874f78825e5eddb7f14158"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/9fdf6152e6874f78825e5eddb7f14158"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/9fdf6152e6874f78825e5eddb7f14158"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_9fdf6152e6874f78825e5eddb7f14158"}]}] May 26 18:05:06.516206 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant: tempest-VolumesSnapshotTestJSON-158119209 May 26 18:05:06.516206 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant-Id: 9fdf6152e6874f78825e5eddb7f14158 May 26 18:05:06.516206 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-158119209 May 26 18:05:06.516206 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User: tempest-VolumesSnapshotTestJSON-158119209-project May 26 18:05:06.516206 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Domain-Id: default May 26 18:05:06.516206 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Domain-Name: Default May 26 18:05:06.516206 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Id: f8b8f37c287341848d8d3b4d5f62873d May 26 18:05:06.516206 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Name: tempest-VolumesSnapshotTestJSON-158119209-project May 26 18:05:06.516206 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: method: > May 26 18:05:06.516206 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: exception: Instance c390424a-1a68-4b4f-abea-917428ba36e5 could not be found. May 26 18:05:06.516206 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: action_args: {'id': 'c390424a-1a68-4b4f-abea-917428ba36e5'} May 26 18:05:06.517405 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:05:06.517405 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:05:06.517405 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:05:06.517405 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:05:06.517405 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:05:06.517405 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:05:06.517405 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:05:06.517405 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:05:06.517405 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:05:06.517405 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:05:06.517405 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c390424a-1a68-4b4f-abea-917428ba36e5 could not be found. May 26 18:05:06.517405 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:05:06.517405 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:05:06.517405 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:05:06.517405 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:05:06.517405 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:05:06.517405 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:05:06.517405 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:05:06.517405 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:05:06.517405 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:05:06.519475 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:05:06.519475 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:05:06.519475 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:05:06.519475 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:05:06.519475 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:05:06.519475 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:05:06.519475 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:05:06.519475 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c390424a-1a68-4b4f-abea-917428ba36e5 could not be found. May 26 18:05:06.519475 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:05:06.519475 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:05:06.519475 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:05:06.519475 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:05:06.519475 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:05:06.519475 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:05:06.519475 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:05:06.519475 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:05:06.519475 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c390424a-1a68-4b4f-abea-917428ba36e5 could not be found. May 26 18:05:06.519475 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:05:06.523100 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-d577d9c8-51e8-4c77-9c2d-aece0f02c49f tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] Returning 404 to user: Instance c390424a-1a68-4b4f-abea-917428ba36e5 could not be found. {{(pid=117722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:05:06.523100 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-d577d9c8-51e8-4c77-9c2d-aece0f02c49f tempest-VolumesSnapshotTestJSON-158119209 tempest-VolumesSnapshotTestJSON-158119209-project] 10.222.0.69 "GET /compute/v2.1/servers/c390424a-1a68-4b4f-abea-917428ba36e5" status: 404 len: 111 microversion: 2.1 time: 0.043762 May 26 18:05:06.523100 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 285/531] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:05:06 2022] GET /compute/v2.1/servers/c390424a-1a68-4b4f-abea-917428ba36e5 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:05:07.505604 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-de9de836-af60-4800-b6ed-35ad6625d5f9 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:07.506483 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-de9de836-af60-4800-b6ed-35ad6625d5f9 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:07.516249 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-de9de836-af60-4800-b6ed-35ad6625d5f9 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:07.516694 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-de9de836-af60-4800-b6ed-35ad6625d5f9 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:07.517497 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-de9de836-af60-4800-b6ed-35ad6625d5f9 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:07.517939 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-de9de836-af60-4800-b6ed-35ad6625d5f9 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:07.705807 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-de9de836-af60-4800-b6ed-35ad6625d5f9 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:07.716184 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-de9de836-af60-4800-b6ed-35ad6625d5f9 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1442 microversion: 2.1 time: 0.214473 May 26 18:05:07.716905 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 247/532] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:05:07 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1442 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:07.746437 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-696d0dd2-48df-454e-9f0c-f749035299f7 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:07.747558 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-696d0dd2-48df-454e-9f0c-f749035299f7 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:07.759128 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-696d0dd2-48df-454e-9f0c-f749035299f7 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:07.760461 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-696d0dd2-48df-454e-9f0c-f749035299f7 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:07.761949 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-696d0dd2-48df-454e-9f0c-f749035299f7 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:07.762694 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-696d0dd2-48df-454e-9f0c-f749035299f7 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:08.253344 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-696d0dd2-48df-454e-9f0c-f749035299f7 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:08.263626 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-696d0dd2-48df-454e-9f0c-f749035299f7 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1442 microversion: 2.1 time: 0.524793 May 26 18:05:08.264353 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 286/533] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:05:07 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1442 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:10.409636 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-74720404-c794-4b4c-9e03-be85c726f8f5 req-2af47998-8354-4770-b571-7ac17a48fd13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e417922-03b2-40d5-814a-4303948ed31b", "tag": "971e49f3-13e4-4d71-a577-21b1d36cef54"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:05:10.419252 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-74720404-c794-4b4c-9e03-be85c726f8f5 req-2af47998-8354-4770-b571-7ac17a48fd13 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:10.419706 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-74720404-c794-4b4c-9e03-be85c726f8f5 req-2af47998-8354-4770-b571-7ac17a48fd13 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:10.432540 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-74720404-c794-4b4c-9e03-be85c726f8f5 req-2af47998-8354-4770-b571-7ac17a48fd13 service nova] Creating event network-changed:971e49f3-13e4-4d71-a577-21b1d36cef54 for instance 8e417922-03b2-40d5-814a-4303948ed31b on hv-cinder-83607 May 26 18:05:10.438078 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-74720404-c794-4b4c-9e03-be85c726f8f5 req-2af47998-8354-4770-b571-7ac17a48fd13 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032815 May 26 18:05:10.438871 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 248/534] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:05:13.533465 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-62e83c3a-c4bc-4cec-bbd0-1f20342113b7 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:13.534109 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-62e83c3a-c4bc-4cec-bbd0-1f20342113b7 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:13.541890 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-62e83c3a-c4bc-4cec-bbd0-1f20342113b7 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:13.542344 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-62e83c3a-c4bc-4cec-bbd0-1f20342113b7 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:13.543138 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-62e83c3a-c4bc-4cec-bbd0-1f20342113b7 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:13.543583 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-62e83c3a-c4bc-4cec-bbd0-1f20342113b7 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:13.700671 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.objects.instance [None req-62e83c3a-c4bc-4cec-bbd0-1f20342113b7 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lazy-loading 'services' on Instance uuid bcca8b79-ed51-48fa-85ad-4af0a09f7c20 {{(pid=117722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:05:13.838109 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-62e83c3a-c4bc-4cec-bbd0-1f20342113b7 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "DELETE /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20/os-volume_attachments/324022c1-7a67-48f2-8a01-1f21139219f8" status: 202 len: 0 microversion: 2.1 time: 0.308550 May 26 18:05:13.838833 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 287/535] 10.222.0.69 () {58 vars in 1415 bytes} [Thu May 26 18:05:13 2022] DELETE /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20/os-volume_attachments/324022c1-7a67-48f2-8a01-1f21139219f8 => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:05:14.987958 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-2ab72baa-d871-4bf9-a0f3-39dedeb6b2e4 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:05:14.997659 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2ab72baa-d871-4bf9-a0f3-39dedeb6b2e4 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:14.998119 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2ab72baa-d871-4bf9-a0f3-39dedeb6b2e4 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:15.030407 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-2ab72baa-d871-4bf9-a0f3-39dedeb6b2e4 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Going to try to stop instance {{(pid=117723) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 26 18:05:15.079213 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-2ab72baa-d871-4bf9-a0f3-39dedeb6b2e4 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "POST /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20/action" status: 202 len: 0 microversion: 2.1 time: 0.100197 May 26 18:05:15.079851 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 249/536] 10.222.0.69 () {60 vars in 1277 bytes} [Thu May 26 18:05:14 2022] POST /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:05:15.089605 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-655aa855-7d57-4275-b975-6cf643fa18b5 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:15.090501 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-655aa855-7d57-4275-b975-6cf643fa18b5 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:15.098454 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-655aa855-7d57-4275-b975-6cf643fa18b5 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:15.098993 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-655aa855-7d57-4275-b975-6cf643fa18b5 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:15.099863 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-655aa855-7d57-4275-b975-6cf643fa18b5 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:15.100422 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-655aa855-7d57-4275-b975-6cf643fa18b5 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:15.278318 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-655aa855-7d57-4275-b975-6cf643fa18b5 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:15.287371 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-655aa855-7d57-4275-b975-6cf643fa18b5 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1675 microversion: 2.1 time: 0.202452 May 26 18:05:15.288047 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 288/537] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:05:15 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1675 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:05:16.307350 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-338ea412-5c9f-41e0-9d81-6eb780bfa292 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:16.308089 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-338ea412-5c9f-41e0-9d81-6eb780bfa292 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:16.314990 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-338ea412-5c9f-41e0-9d81-6eb780bfa292 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:16.315442 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-338ea412-5c9f-41e0-9d81-6eb780bfa292 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:16.316282 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-338ea412-5c9f-41e0-9d81-6eb780bfa292 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:16.316728 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-338ea412-5c9f-41e0-9d81-6eb780bfa292 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:16.502133 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-338ea412-5c9f-41e0-9d81-6eb780bfa292 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:16.509220 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:05:16.519768 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-338ea412-5c9f-41e0-9d81-6eb780bfa292 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1675 microversion: 2.1 time: 0.217122 May 26 18:05:16.520817 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 250/538] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:05:16 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1675 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:05:17.546887 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-8f6cabb8-7cd4-4934-827c-f06af52c7191 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:17.547603 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-8f6cabb8-7cd4-4934-827c-f06af52c7191 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:17.554737 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-8f6cabb8-7cd4-4934-827c-f06af52c7191 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:17.555240 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-8f6cabb8-7cd4-4934-827c-f06af52c7191 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:17.556075 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-8f6cabb8-7cd4-4934-827c-f06af52c7191 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:17.556526 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-8f6cabb8-7cd4-4934-827c-f06af52c7191 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:17.716975 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-8f6cabb8-7cd4-4934-827c-f06af52c7191 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:17.726414 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-8f6cabb8-7cd4-4934-827c-f06af52c7191 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1675 microversion: 2.1 time: 0.183425 May 26 18:05:17.727775 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 289/539] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:05:17 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1675 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:18.746889 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-22bdca2b-9f4d-40ea-90ce-abfd060133a2 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:18.747693 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-22bdca2b-9f4d-40ea-90ce-abfd060133a2 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:18.756443 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-22bdca2b-9f4d-40ea-90ce-abfd060133a2 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:18.756843 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-22bdca2b-9f4d-40ea-90ce-abfd060133a2 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:18.757715 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-22bdca2b-9f4d-40ea-90ce-abfd060133a2 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:18.758696 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-22bdca2b-9f4d-40ea-90ce-abfd060133a2 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:18.917223 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-22bdca2b-9f4d-40ea-90ce-abfd060133a2 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:18.925377 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-22bdca2b-9f4d-40ea-90ce-abfd060133a2 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1675 microversion: 2.1 time: 0.183713 May 26 18:05:18.925976 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 251/540] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:05:18 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1675 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:19.943859 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-0b5c89df-b403-453a-9142-201f6d36e32e tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:19.944547 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-0b5c89df-b403-453a-9142-201f6d36e32e tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:19.952315 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0b5c89df-b403-453a-9142-201f6d36e32e tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:19.952773 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0b5c89df-b403-453a-9142-201f6d36e32e tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:19.953602 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0b5c89df-b403-453a-9142-201f6d36e32e tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:19.954043 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0b5c89df-b403-453a-9142-201f6d36e32e tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:20.099537 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-0b5c89df-b403-453a-9142-201f6d36e32e tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:20.112084 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-0b5c89df-b403-453a-9142-201f6d36e32e tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1675 microversion: 2.1 time: 0.171704 May 26 18:05:20.113309 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 290/541] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:05:19 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1675 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:21.131789 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-56acd0a4-6d81-4fbd-a6e0-6db257ec6769 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:21.133490 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-56acd0a4-6d81-4fbd-a6e0-6db257ec6769 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:21.142137 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-56acd0a4-6d81-4fbd-a6e0-6db257ec6769 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:21.143032 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-56acd0a4-6d81-4fbd-a6e0-6db257ec6769 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:21.143748 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-56acd0a4-6d81-4fbd-a6e0-6db257ec6769 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:21.144294 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-56acd0a4-6d81-4fbd-a6e0-6db257ec6769 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:21.380632 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-56acd0a4-6d81-4fbd-a6e0-6db257ec6769 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:21.399550 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-56acd0a4-6d81-4fbd-a6e0-6db257ec6769 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1675 microversion: 2.1 time: 0.270943 May 26 18:05:21.400281 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 252/542] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:05:21 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1675 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:22.423307 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-20a4c279-a127-4a5c-a733-30f338379080 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:22.424466 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-20a4c279-a127-4a5c-a733-30f338379080 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:22.436884 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-20a4c279-a127-4a5c-a733-30f338379080 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:22.437687 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-20a4c279-a127-4a5c-a733-30f338379080 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:22.439285 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-20a4c279-a127-4a5c-a733-30f338379080 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:22.440136 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-20a4c279-a127-4a5c-a733-30f338379080 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:22.602213 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-20a4c279-a127-4a5c-a733-30f338379080 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:22.613633 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-20a4c279-a127-4a5c-a733-30f338379080 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1675 microversion: 2.1 time: 0.197405 May 26 18:05:22.623814 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 291/543] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:05:22 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1675 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:05:23.635811 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-a90ba71a-92eb-4e0c-84f8-62010663b533 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:23.636977 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-a90ba71a-92eb-4e0c-84f8-62010663b533 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:23.649041 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a90ba71a-92eb-4e0c-84f8-62010663b533 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:23.649835 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a90ba71a-92eb-4e0c-84f8-62010663b533 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:23.651248 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a90ba71a-92eb-4e0c-84f8-62010663b533 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:23.652043 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a90ba71a-92eb-4e0c-84f8-62010663b533 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:23.881180 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-a90ba71a-92eb-4e0c-84f8-62010663b533 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:23.890398 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-a90ba71a-92eb-4e0c-84f8-62010663b533 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1675 microversion: 2.1 time: 0.262700 May 26 18:05:23.891265 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 253/544] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:05:23 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1675 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:24.912363 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-bcd7f9bd-dba6-4b2d-999b-9223ca7a6bfe tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:24.914777 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-bcd7f9bd-dba6-4b2d-999b-9223ca7a6bfe tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:24.928163 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-bcd7f9bd-dba6-4b2d-999b-9223ca7a6bfe tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:24.928975 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-bcd7f9bd-dba6-4b2d-999b-9223ca7a6bfe tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:24.930961 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-bcd7f9bd-dba6-4b2d-999b-9223ca7a6bfe tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:24.931575 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-bcd7f9bd-dba6-4b2d-999b-9223ca7a6bfe tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:25.113502 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-bcd7f9bd-dba6-4b2d-999b-9223ca7a6bfe tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:25.119369 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-bcd7f9bd-dba6-4b2d-999b-9223ca7a6bfe tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1675 microversion: 2.1 time: 0.213078 May 26 18:05:25.120225 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 292/545] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:05:24 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1675 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:26.137999 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-a1348207-9d08-4380-abc7-e051d860f602 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:26.138705 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-a1348207-9d08-4380-abc7-e051d860f602 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:26.145804 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a1348207-9d08-4380-abc7-e051d860f602 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:26.146258 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a1348207-9d08-4380-abc7-e051d860f602 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:26.147049 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a1348207-9d08-4380-abc7-e051d860f602 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:26.147493 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a1348207-9d08-4380-abc7-e051d860f602 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:26.311552 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-a1348207-9d08-4380-abc7-e051d860f602 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:26.324367 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-a1348207-9d08-4380-abc7-e051d860f602 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1675 microversion: 2.1 time: 0.190212 May 26 18:05:26.325251 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 254/546] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:05:26 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1675 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:27.350855 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-c5a10567-d553-4ae3-a0b9-1524b7d701c9 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:27.351996 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-c5a10567-d553-4ae3-a0b9-1524b7d701c9 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:27.356483 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_api:SELECT=44 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:05:27.366526 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c5a10567-d553-4ae3-a0b9-1524b7d701c9 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:27.367811 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c5a10567-d553-4ae3-a0b9-1524b7d701c9 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:27.369263 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c5a10567-d553-4ae3-a0b9-1524b7d701c9 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:27.370045 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c5a10567-d553-4ae3-a0b9-1524b7d701c9 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:27.559678 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-c5a10567-d553-4ae3-a0b9-1524b7d701c9 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:27.574845 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-c5a10567-d553-4ae3-a0b9-1524b7d701c9 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1675 microversion: 2.1 time: 0.231621 May 26 18:05:27.575866 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 293/547] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:05:27 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1675 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:28.599481 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-3b9a2845-f089-4c90-a701-8dfb6c7a35d9 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:28.600808 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-3b9a2845-f089-4c90-a701-8dfb6c7a35d9 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:28.610016 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3b9a2845-f089-4c90-a701-8dfb6c7a35d9 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:28.610848 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3b9a2845-f089-4c90-a701-8dfb6c7a35d9 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:28.612249 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3b9a2845-f089-4c90-a701-8dfb6c7a35d9 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:28.613071 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3b9a2845-f089-4c90-a701-8dfb6c7a35d9 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:28.779062 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-3b9a2845-f089-4c90-a701-8dfb6c7a35d9 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:28.794549 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-3b9a2845-f089-4c90-a701-8dfb6c7a35d9 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1675 microversion: 2.1 time: 0.199504 May 26 18:05:28.795617 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 255/548] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:05:28 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1675 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:29.824006 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-772e76c6-2b88-4958-86da-cae9140cf715 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:29.824875 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-772e76c6-2b88-4958-86da-cae9140cf715 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:29.831926 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-772e76c6-2b88-4958-86da-cae9140cf715 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:29.832450 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-772e76c6-2b88-4958-86da-cae9140cf715 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:29.833426 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-772e76c6-2b88-4958-86da-cae9140cf715 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:29.833985 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-772e76c6-2b88-4958-86da-cae9140cf715 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:29.992816 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-772e76c6-2b88-4958-86da-cae9140cf715 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:30.000638 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-772e76c6-2b88-4958-86da-cae9140cf715 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1675 microversion: 2.1 time: 0.180956 May 26 18:05:30.001233 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 294/549] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:05:29 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1675 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:05:31.020542 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-0d98b24c-ec21-4810-b660-ca64971ba65c tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:31.021263 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-0d98b24c-ec21-4810-b660-ca64971ba65c tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:31.024664 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:05:31.034332 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0d98b24c-ec21-4810-b660-ca64971ba65c tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:31.035077 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0d98b24c-ec21-4810-b660-ca64971ba65c tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:31.036852 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0d98b24c-ec21-4810-b660-ca64971ba65c tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:31.037583 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0d98b24c-ec21-4810-b660-ca64971ba65c tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:31.202038 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-85065086-87cd-4824-b4f6-54fa9a72e25d tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "90236f05-8d50-4481-aa60-e8f63e231893"}} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:05:31.205370 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-85065086-87cd-4824-b4f6-54fa9a72e25d tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 704b23df-a1e8-425f-a6bf-4805b1356866] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:31.218947 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-85065086-87cd-4824-b4f6-54fa9a72e25d tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:31.220260 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-85065086-87cd-4824-b4f6-54fa9a72e25d tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:31.222020 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-85065086-87cd-4824-b4f6-54fa9a72e25d tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:31.223161 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-85065086-87cd-4824-b4f6-54fa9a72e25d tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:31.229767 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-0d98b24c-ec21-4810-b660-ca64971ba65c tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:31.238881 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-0d98b24c-ec21-4810-b660-ca64971ba65c tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1652 microversion: 2.1 time: 0.222424 May 26 18:05:31.244086 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 256/550] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:05:31 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1652 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:31.258857 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:05:31.266719 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-141609d9-374b-48bd-949d-207ba57ace88 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:05:31.282079 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-141609d9-374b-48bd-949d-207ba57ace88 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:31.283972 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-141609d9-374b-48bd-949d-207ba57ace88 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:31.326236 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-141609d9-374b-48bd-949d-207ba57ace88 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Going to try to start instance {{(pid=117723) start /opt/stack/nova/nova/compute/api.py:2730}} May 26 18:05:31.398438 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-141609d9-374b-48bd-949d-207ba57ace88 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "POST /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20/action" status: 202 len: 0 microversion: 2.1 time: 0.142192 May 26 18:05:31.400053 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 257/551] 10.222.0.69 () {60 vars in 1277 bytes} [Thu May 26 18:05:31 2022] POST /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:05:31.416211 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-75caffac-125a-4f3a-b9f0-498fe549dca9 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:31.417676 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-75caffac-125a-4f3a-b9f0-498fe549dca9 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:31.431013 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-75caffac-125a-4f3a-b9f0-498fe549dca9 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:31.431502 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-75caffac-125a-4f3a-b9f0-498fe549dca9 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:31.432795 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-75caffac-125a-4f3a-b9f0-498fe549dca9 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:31.433616 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-75caffac-125a-4f3a-b9f0-498fe549dca9 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:31.652955 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-85065086-87cd-4824-b4f6-54fa9a72e25d tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "POST /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.458084 May 26 18:05:31.653428 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 295/552] 10.222.0.69 () {60 vars in 1322 bytes} [Thu May 26 18:05:31 2022] POST /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866/os-volume_attachments => generated 194 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:05:31.801194 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-75caffac-125a-4f3a-b9f0-498fe549dca9 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:31.811450 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-75caffac-125a-4f3a-b9f0-498fe549dca9 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1661 microversion: 2.1 time: 0.404410 May 26 18:05:31.812354 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 258/553] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:05:31 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1661 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:32.843163 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-e2000384-5f88-4303-b535-a33d6e1eeb21 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:32.844765 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-e2000384-5f88-4303-b535-a33d6e1eeb21 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:32.857275 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e2000384-5f88-4303-b535-a33d6e1eeb21 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:32.858044 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e2000384-5f88-4303-b535-a33d6e1eeb21 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:32.859366 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e2000384-5f88-4303-b535-a33d6e1eeb21 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:32.860130 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e2000384-5f88-4303-b535-a33d6e1eeb21 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:33.068990 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-e2000384-5f88-4303-b535-a33d6e1eeb21 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:33.079392 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-e2000384-5f88-4303-b535-a33d6e1eeb21 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1661 microversion: 2.1 time: 0.245561 May 26 18:05:33.080097 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 296/554] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:05:32 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1661 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:05:34.104800 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-f5e5f055-7d71-4eb4-b22b-31f9d13fd515 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:34.105649 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-f5e5f055-7d71-4eb4-b22b-31f9d13fd515 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:34.113043 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f5e5f055-7d71-4eb4-b22b-31f9d13fd515 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:34.113868 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f5e5f055-7d71-4eb4-b22b-31f9d13fd515 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:34.114666 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f5e5f055-7d71-4eb4-b22b-31f9d13fd515 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:34.115110 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f5e5f055-7d71-4eb4-b22b-31f9d13fd515 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:34.342536 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-f5e5f055-7d71-4eb4-b22b-31f9d13fd515 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:34.357181 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-f5e5f055-7d71-4eb4-b22b-31f9d13fd515 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1665 microversion: 2.1 time: 0.257270 May 26 18:05:34.362192 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 259/555] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:05:34 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1665 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:05:39.464534 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-d8425e1f-3d94-4f63-85d0-7738cb7b0fbd tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:05:39.466725 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-d8425e1f-3d94-4f63-85d0-7738cb7b0fbd tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 704b23df-a1e8-425f-a6bf-4805b1356866] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:39.479731 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d8425e1f-3d94-4f63-85d0-7738cb7b0fbd tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:39.480727 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d8425e1f-3d94-4f63-85d0-7738cb7b0fbd tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:39.483687 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d8425e1f-3d94-4f63-85d0-7738cb7b0fbd tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:39.484544 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d8425e1f-3d94-4f63-85d0-7738cb7b0fbd tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:39.526862 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.objects.instance [None req-d8425e1f-3d94-4f63-85d0-7738cb7b0fbd tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lazy-loading 'flavor' on Instance uuid 704b23df-a1e8-425f-a6bf-4805b1356866 {{(pid=117722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:05:39.747433 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-d8425e1f-3d94-4f63-85d0-7738cb7b0fbd tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "POST /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866/action" status: 200 len: 32 microversion: 2.1 time: 0.288180 May 26 18:05:39.749507 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 297/556] 10.222.0.69 () {60 vars in 1277 bytes} [Thu May 26 18:05:39 2022] POST /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866/action => generated 32 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 18:05:39.767324 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-4c9f5e71-718e-4531-a08c-4752c78c4eb3 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:39.768290 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-4c9f5e71-718e-4531-a08c-4752c78c4eb3 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 704b23df-a1e8-425f-a6bf-4805b1356866] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:39.774917 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4c9f5e71-718e-4531-a08c-4752c78c4eb3 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:39.775534 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4c9f5e71-718e-4531-a08c-4752c78c4eb3 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:39.776417 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4c9f5e71-718e-4531-a08c-4752c78c4eb3 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:39.777051 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4c9f5e71-718e-4531-a08c-4752c78c4eb3 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:40.216662 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-4c9f5e71-718e-4531-a08c-4752c78c4eb3 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:40.230335 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-4c9f5e71-718e-4531-a08c-4752c78c4eb3 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866" status: 200 len: 1735 microversion: 2.1 time: 0.467445 May 26 18:05:40.232660 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 260/557] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:05:39 2022] GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866 => generated 1735 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:41.256958 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-cb06b137-a39b-44af-b400-69a7797433b8 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:41.257918 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-cb06b137-a39b-44af-b400-69a7797433b8 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 704b23df-a1e8-425f-a6bf-4805b1356866] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:41.265994 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-cb06b137-a39b-44af-b400-69a7797433b8 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:41.266744 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-cb06b137-a39b-44af-b400-69a7797433b8 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:41.267541 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-cb06b137-a39b-44af-b400-69a7797433b8 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:41.268449 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-cb06b137-a39b-44af-b400-69a7797433b8 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:41.463594 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-cb06b137-a39b-44af-b400-69a7797433b8 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:41.478059 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-cb06b137-a39b-44af-b400-69a7797433b8 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866" status: 200 len: 1735 microversion: 2.1 time: 0.226428 May 26 18:05:41.479789 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 298/558] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:05:41 2022] GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866 => generated 1735 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:42.509740 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-e7300004-d029-4475-8f9d-2a329e247c8f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:42.510901 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-e7300004-d029-4475-8f9d-2a329e247c8f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 704b23df-a1e8-425f-a6bf-4805b1356866] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:42.523861 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e7300004-d029-4475-8f9d-2a329e247c8f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:42.525100 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e7300004-d029-4475-8f9d-2a329e247c8f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:42.526582 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e7300004-d029-4475-8f9d-2a329e247c8f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:42.527386 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e7300004-d029-4475-8f9d-2a329e247c8f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:42.756341 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-e7300004-d029-4475-8f9d-2a329e247c8f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:42.771558 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-e7300004-d029-4475-8f9d-2a329e247c8f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866" status: 200 len: 1735 microversion: 2.1 time: 0.272450 May 26 18:05:42.772705 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 261/559] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:05:42 2022] GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866 => generated 1735 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:43.796788 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-31e973e7-a467-482b-b2a3-4178008890cd tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:43.801897 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-31e973e7-a467-482b-b2a3-4178008890cd tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 704b23df-a1e8-425f-a6bf-4805b1356866] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:43.820387 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-31e973e7-a467-482b-b2a3-4178008890cd tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:43.823681 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-31e973e7-a467-482b-b2a3-4178008890cd tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:43.826580 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-31e973e7-a467-482b-b2a3-4178008890cd tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:43.827473 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-31e973e7-a467-482b-b2a3-4178008890cd tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:44.056616 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-31e973e7-a467-482b-b2a3-4178008890cd tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:44.071490 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-31e973e7-a467-482b-b2a3-4178008890cd tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866" status: 200 len: 1735 microversion: 2.1 time: 0.283881 May 26 18:05:44.072469 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 299/560] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:05:43 2022] GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866 => generated 1735 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:45.105094 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-2a1b9622-fff1-4dad-8c6b-278d8410e7db tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:45.106574 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-2a1b9622-fff1-4dad-8c6b-278d8410e7db tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 704b23df-a1e8-425f-a6bf-4805b1356866] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:45.113625 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2a1b9622-fff1-4dad-8c6b-278d8410e7db tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:45.114095 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2a1b9622-fff1-4dad-8c6b-278d8410e7db tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:45.114881 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2a1b9622-fff1-4dad-8c6b-278d8410e7db tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:45.115317 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2a1b9622-fff1-4dad-8c6b-278d8410e7db tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:45.334514 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-2a1b9622-fff1-4dad-8c6b-278d8410e7db tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:45.344250 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-2a1b9622-fff1-4dad-8c6b-278d8410e7db tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866" status: 200 len: 1735 microversion: 2.1 time: 0.243894 May 26 18:05:45.345348 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 262/561] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:05:45 2022] GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866 => generated 1735 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:46.046837 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-7cc290ff-dfe1-47ee-812f-4888ae614788 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Action: 'create', calling method: .version_select at 0x7f3ab8b27040>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-388820237", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE33tLg9AvYdmP6hVEYFH2vtV1BM+rGUkPCXSHMspNh2bwplVrt3//VaB2ymjRSHrOxh21Zex/apSYKuRgXo/0oPrwsiPHh57lTfoHL14HizCL5Y1ZdLJdZ72rN1dU85RQ=="}} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:05:46.064307 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.quota [None req-7cc290ff-dfe1-47ee-812f-4888ae614788 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Getting quotas for project ba5a75cf80284f58b9c3bed674677a39. Resources: {'key_pairs'} {{(pid=117722) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:05:46.070338 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.quota [None req-7cc290ff-dfe1-47ee-812f-4888ae614788 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Getting quotas for user 9683ec43ae844757883a7dd5003b53d9 and project ba5a75cf80284f58b9c3bed674677a39. Resources: {'key_pairs'} {{(pid=117722) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:05:46.094526 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-7cc290ff-dfe1-47ee-812f-4888ae614788 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.251556 May 26 18:05:46.095154 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 300/562] 10.222.0.69 () {60 vars in 1158 bytes} [Thu May 26 18:05:45 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:05:46.362970 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-44c20498-feac-468a-a338-e25c9474a007 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:46.363669 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-44c20498-feac-468a-a338-e25c9474a007 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 704b23df-a1e8-425f-a6bf-4805b1356866] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:46.370555 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-44c20498-feac-468a-a338-e25c9474a007 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:46.371008 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-44c20498-feac-468a-a338-e25c9474a007 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:46.371801 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-44c20498-feac-468a-a338-e25c9474a007 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:46.372305 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-44c20498-feac-468a-a338-e25c9474a007 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:46.524501 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-44c20498-feac-468a-a338-e25c9474a007 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:46.533367 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-44c20498-feac-468a-a338-e25c9474a007 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866" status: 200 len: 1735 microversion: 2.1 time: 0.174234 May 26 18:05:46.533934 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 263/563] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:05:46 2022] GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866 => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:47.034796 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-b6879153-0651-487f-9f81-be7be7882b33 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:47.039322 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-b6879153-0651-487f-9f81-be7be7882b33 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 6bb99e9b-15af-408e-af01-6e08b8294058] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:47.047114 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b6879153-0651-487f-9f81-be7be7882b33 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:47.048301 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b6879153-0651-487f-9f81-be7be7882b33 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:47.049265 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b6879153-0651-487f-9f81-be7be7882b33 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:47.049848 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b6879153-0651-487f-9f81-be7be7882b33 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:47.090739 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-b6879153-0651-487f-9f81-be7be7882b33 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058/ips" status: 200 len: 150 microversion: 2.1 time: 0.060109 May 26 18:05:47.092485 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 301/564] 10.222.0.69 () {58 vars in 1247 bytes} [Thu May 26 18:05:47 2022] GET /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058/ips => generated 150 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:05:47.104185 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-01b588cb-eb0e-486f-bd5c-8538acaf6cf3 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4a5f9e32-e491-4a4a-afcf-a38e87c2c87a"}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:05:47.105569 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-01b588cb-eb0e-486f-bd5c-8538acaf6cf3 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 6bb99e9b-15af-408e-af01-6e08b8294058] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:47.112148 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-01b588cb-eb0e-486f-bd5c-8538acaf6cf3 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:47.112610 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-01b588cb-eb0e-486f-bd5c-8538acaf6cf3 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:47.113637 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-01b588cb-eb0e-486f-bd5c-8538acaf6cf3 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:47.114267 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-01b588cb-eb0e-486f-bd5c-8538acaf6cf3 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:47.214917 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.wsgi [None req-01b588cb-eb0e-486f-bd5c-8538acaf6cf3 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] HTTP exception thrown: Invalid volume: volume 4a5f9e32-e491-4a4a-afcf-a38e87c2c87a is already attached to instances: fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7 May 26 18:05:47.217417 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-01b588cb-eb0e-486f-bd5c-8538acaf6cf3 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Request method failure captured: May 26 18:05:47.217417 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: request: POST /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058/os-volume_attachments HTTP/1.1 May 26 18:05:47.217417 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Accept: application/json May 26 18:05:47.217417 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Accept-Encoding: identity May 26 18:05:47.217417 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Connection: close May 26 18:05:47.217417 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Content-Length: 74 May 26 18:05:47.217417 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Content-Type: application/json May 26 18:05:47.217417 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Host: 10.222.0.69 May 26 18:05:47.217417 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Openstack-System-Scope: None May 26 18:05:47.217417 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: User-Agent: python-urllib3/1.26.9 May 26 18:05:47.217417 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Auth-Token: gAAAAABij8DD0GGF2lSLDsyvjDvkvKuYTmd8MhBJFcuAgLQjYIxaUzVYvy2y78Ufugs1Oc4LrOO28-M4MWgXvAjDAFM656TsVGzxmhayY-bOw7ExJ5yRcG231tnUdWRr6zrbitvFAB7wzSB1IdWp2Auh8VsxEfhGR0YnizUXC6yVsCWiAksLALA May 26 18:05:47.217417 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Domain-Id: None May 26 18:05:47.217417 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Domain-Name: None May 26 18:05:47.217417 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Identity-Status: Confirmed May 26 18:05:47.217417 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Is-Admin-Project: True May 26 18:05:47.217417 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Domain-Id: default May 26 18:05:47.217417 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Domain-Name: Default May 26 18:05:47.217417 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Id: 8920d2de9dc34386bb0e770f5b51b702 May 26 18:05:47.217417 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Name: tempest-AttachVolumeNegativeTest-2031663802 May 26 18:05:47.217417 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Role: member,reader May 26 18:05:47.217417 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Roles: member,reader May 26 18:05:47.219117 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8920d2de9dc34386bb0e770f5b51b702"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8920d2de9dc34386bb0e770f5b51b702"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8920d2de9dc34386bb0e770f5b51b702"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8920d2de9dc34386bb0e770f5b51b702"}]}] May 26 18:05:47.219117 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant: tempest-AttachVolumeNegativeTest-2031663802 May 26 18:05:47.219117 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant-Id: 8920d2de9dc34386bb0e770f5b51b702 May 26 18:05:47.219117 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2031663802 May 26 18:05:47.219117 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User: tempest-AttachVolumeNegativeTest-2031663802-project May 26 18:05:47.219117 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Domain-Id: default May 26 18:05:47.219117 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Domain-Name: Default May 26 18:05:47.219117 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Id: 2691e1dc96e942b5ba4c726b72a835e9 May 26 18:05:47.219117 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Name: tempest-AttachVolumeNegativeTest-2031663802-project May 26 18:05:47.219117 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: May 26 18:05:47.219117 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: {"volumeAttachment": {"volumeId": "4a5f9e32-e491-4a4a-afcf-a38e87c2c87a"}} May 26 18:05:47.219117 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: method: > May 26 18:05:47.220200 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: exception: Invalid volume: volume 4a5f9e32-e491-4a4a-afcf-a38e87c2c87a is already attached to instances: fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7 May 26 18:05:47.220200 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: action_args: {'server_id': '6bb99e9b-15af-408e-af01-6e08b8294058', 'body': {'volumeAttachment': {'volumeId': '4a5f9e32-e491-4a4a-afcf-a38e87c2c87a'}}} May 26 18:05:47.220200 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:05:47.220200 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:05:47.220200 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 26 18:05:47.220200 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 26 18:05:47.220200 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 18:05:47.220200 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 18:05:47.220200 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 26 18:05:47.220200 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 26 18:05:47.220200 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 26 18:05:47.220200 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 26 18:05:47.220200 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 26 18:05:47.220200 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 26 18:05:47.220200 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4a5f9e32-e491-4a4a-afcf-a38e87c2c87a is already attached to instances: fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7 May 26 18:05:47.220200 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:05:47.220200 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:05:47.220200 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:05:47.220200 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:05:47.222484 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:05:47.222484 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:05:47.222484 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:05:47.222484 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:05:47.222484 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:05:47.222484 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:05:47.222484 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 18:05:47.222484 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 18:05:47.222484 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 18:05:47.222484 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 18:05:47.222484 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 18:05:47.222484 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 18:05:47.222484 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 26 18:05:47.222484 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 26 18:05:47.222484 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4a5f9e32-e491-4a4a-afcf-a38e87c2c87a is already attached to instances: fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7 May 26 18:05:47.222484 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:05:47.222484 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:05:47.222484 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:05:47.222484 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:05:47.222484 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:05:47.226860 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:05:47.226860 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:05:47.226860 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:05:47.226860 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4a5f9e32-e491-4a4a-afcf-a38e87c2c87a is already attached to instances: fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7 May 26 18:05:47.226860 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:05:47.226860 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-01b588cb-eb0e-486f-bd5c-8538acaf6cf3 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Returning 400 to user: Invalid volume: volume 4a5f9e32-e491-4a4a-afcf-a38e87c2c87a is already attached to instances: fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7 {{(pid=117723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:05:47.226860 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-01b588cb-eb0e-486f-bd5c-8538acaf6cf3 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "POST /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.120651 May 26 18:05:47.226860 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 264/565] 10.222.0.69 () {60 vars in 1322 bytes} [Thu May 26 18:05:47 2022] POST /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058/os-volume_attachments => generated 174 bytes in 122 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 18:05:47.231670 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-01e5bff8-df8d-4aae-8f75-5984d28a019c tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:47.232205 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-01e5bff8-df8d-4aae-8f75-5984d28a019c tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 6bb99e9b-15af-408e-af01-6e08b8294058] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:47.238808 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-01e5bff8-df8d-4aae-8f75-5984d28a019c tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:47.239441 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-01e5bff8-df8d-4aae-8f75-5984d28a019c tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:47.240272 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-01e5bff8-df8d-4aae-8f75-5984d28a019c tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:47.242056 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-01e5bff8-df8d-4aae-8f75-5984d28a019c tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:47.268835 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-01e5bff8-df8d-4aae-8f75-5984d28a019c tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 6bb99e9b-15af-408e-af01-6e08b8294058] Going to try to terminate instance {{(pid=117722) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:05:47.364671 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-01e5bff8-df8d-4aae-8f75-5984d28a019c tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "DELETE /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058" status: 204 len: 0 microversion: 2.1 time: 0.138469 May 26 18:05:47.366883 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 302/566] 10.222.0.69 () {58 vars in 1238 bytes} [Thu May 26 18:05:47 2022] DELETE /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 26 18:05:47.378000 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-9d4b6d84-927d-4a8b-bf42-f78539ab43df tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:47.379423 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-9d4b6d84-927d-4a8b-bf42-f78539ab43df tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 6bb99e9b-15af-408e-af01-6e08b8294058] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:47.393706 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9d4b6d84-927d-4a8b-bf42-f78539ab43df tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:47.395009 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9d4b6d84-927d-4a8b-bf42-f78539ab43df tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:47.396353 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9d4b6d84-927d-4a8b-bf42-f78539ab43df tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:47.397231 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9d4b6d84-927d-4a8b-bf42-f78539ab43df tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:47.552949 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-0c25f351-59d4-4993-b072-ffb4cfb8a526 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:47.554414 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-0c25f351-59d4-4993-b072-ffb4cfb8a526 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 704b23df-a1e8-425f-a6bf-4805b1356866] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:47.562794 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0c25f351-59d4-4993-b072-ffb4cfb8a526 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:47.563644 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0c25f351-59d4-4993-b072-ffb4cfb8a526 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:47.564670 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0c25f351-59d4-4993-b072-ffb4cfb8a526 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:47.565361 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0c25f351-59d4-4993-b072-ffb4cfb8a526 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:47.613266 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-9d4b6d84-927d-4a8b-bf42-f78539ab43df tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:47.623645 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-9d4b6d84-927d-4a8b-bf42-f78539ab43df tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058" status: 200 len: 1681 microversion: 2.1 time: 0.251715 May 26 18:05:47.624478 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 265/567] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:05:47 2022] GET /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058 => generated 1681 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:47.738774 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-0c25f351-59d4-4993-b072-ffb4cfb8a526 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:47.753782 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-0c25f351-59d4-4993-b072-ffb4cfb8a526 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866" status: 200 len: 1735 microversion: 2.1 time: 0.206490 May 26 18:05:47.767434 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 303/568] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:05:47 2022] GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866 => generated 1735 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:48.646141 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-00a9fd9a-8e50-4a42-b7be-d447645fb13f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:48.648533 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-00a9fd9a-8e50-4a42-b7be-d447645fb13f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 6bb99e9b-15af-408e-af01-6e08b8294058] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:48.656271 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-00a9fd9a-8e50-4a42-b7be-d447645fb13f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:48.656815 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-00a9fd9a-8e50-4a42-b7be-d447645fb13f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:48.657688 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-00a9fd9a-8e50-4a42-b7be-d447645fb13f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:48.658197 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-00a9fd9a-8e50-4a42-b7be-d447645fb13f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:48.680138 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:05:48.774288 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-11766a15-3270-4d96-85e4-9c02048731cf tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:48.776287 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-11766a15-3270-4d96-85e4-9c02048731cf tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 704b23df-a1e8-425f-a6bf-4805b1356866] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:48.786602 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-11766a15-3270-4d96-85e4-9c02048731cf tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:48.787232 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-11766a15-3270-4d96-85e4-9c02048731cf tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:48.787897 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-11766a15-3270-4d96-85e4-9c02048731cf tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:48.788421 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-11766a15-3270-4d96-85e4-9c02048731cf tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:48.835092 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-00a9fd9a-8e50-4a42-b7be-d447645fb13f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:48.844962 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-00a9fd9a-8e50-4a42-b7be-d447645fb13f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058" status: 200 len: 1681 microversion: 2.1 time: 0.206253 May 26 18:05:48.845559 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 266/569] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:05:48 2022] GET /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058 => generated 1681 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:48.965138 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-11766a15-3270-4d96-85e4-9c02048731cf tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:49.009779 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-11766a15-3270-4d96-85e4-9c02048731cf tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866" status: 200 len: 1735 microversion: 2.1 time: 0.240056 May 26 18:05:49.018094 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 304/570] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:05:48 2022] GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866 => generated 1735 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:05:49.879420 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-113688d4-33f2-49b6-abd7-6dcf14d153b7 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:49.880750 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-113688d4-33f2-49b6-abd7-6dcf14d153b7 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 6bb99e9b-15af-408e-af01-6e08b8294058] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:49.888956 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-113688d4-33f2-49b6-abd7-6dcf14d153b7 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:49.889570 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-113688d4-33f2-49b6-abd7-6dcf14d153b7 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:49.890483 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-113688d4-33f2-49b6-abd7-6dcf14d153b7 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:49.890994 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-113688d4-33f2-49b6-abd7-6dcf14d153b7 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:50.029309 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-766baecb-50c2-4a9b-ba66-90fa52413f65 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:50.030747 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-766baecb-50c2-4a9b-ba66-90fa52413f65 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 704b23df-a1e8-425f-a6bf-4805b1356866] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:50.041457 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-766baecb-50c2-4a9b-ba66-90fa52413f65 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:50.041954 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-766baecb-50c2-4a9b-ba66-90fa52413f65 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:50.042765 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-766baecb-50c2-4a9b-ba66-90fa52413f65 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:50.043740 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-766baecb-50c2-4a9b-ba66-90fa52413f65 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:50.243587 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-766baecb-50c2-4a9b-ba66-90fa52413f65 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:50.255053 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-766baecb-50c2-4a9b-ba66-90fa52413f65 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866" status: 200 len: 1735 microversion: 2.1 time: 0.230750 May 26 18:05:50.267342 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 305/571] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:05:50 2022] GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866 => generated 1735 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:50.285127 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-113688d4-33f2-49b6-abd7-6dcf14d153b7 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:50.297890 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-113688d4-33f2-49b6-abd7-6dcf14d153b7 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058" status: 200 len: 1681 microversion: 2.1 time: 0.422777 May 26 18:05:50.299193 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 267/572] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:05:49 2022] GET /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058 => generated 1681 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:50.855467 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [req-0d208d65-e57f-4926-8339-4f6e983ec4c3 req-fed89bf1-c868-42dc-bded-734d86ad8bdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bb99e9b-15af-408e-af01-6e08b8294058", "name": "network-vif-deleted", "tag": "0dd6e103-d470-44be-a25f-1cd6fdfa887e"}]} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:05:50.872562 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-0d208d65-e57f-4926-8339-4f6e983ec4c3 req-fed89bf1-c868-42dc-bded-734d86ad8bdf service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:50.873059 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-0d208d65-e57f-4926-8339-4f6e983ec4c3 req-fed89bf1-c868-42dc-bded-734d86ad8bdf service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:50.934085 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.compute.server_external_events [req-0d208d65-e57f-4926-8339-4f6e983ec4c3 req-fed89bf1-c868-42dc-bded-734d86ad8bdf service nova] Creating event network-vif-deleted:0dd6e103-d470-44be-a25f-1cd6fdfa887e for instance 6bb99e9b-15af-408e-af01-6e08b8294058 on hv-cinder-83607 May 26 18:05:50.958491 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [req-0d208d65-e57f-4926-8339-4f6e983ec4c3 req-fed89bf1-c868-42dc-bded-734d86ad8bdf service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106362 May 26 18:05:50.964156 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 306/573] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:05:51.276378 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-f306daa3-c573-47f4-8536-563934e2d5c1 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:51.282577 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-f306daa3-c573-47f4-8536-563934e2d5c1 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 704b23df-a1e8-425f-a6bf-4805b1356866] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:51.301593 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f306daa3-c573-47f4-8536-563934e2d5c1 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:51.302557 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f306daa3-c573-47f4-8536-563934e2d5c1 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:51.303909 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f306daa3-c573-47f4-8536-563934e2d5c1 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:51.304566 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f306daa3-c573-47f4-8536-563934e2d5c1 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:51.318756 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-15d3f978-0c59-464c-bc24-863366ee9d18 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:51.320472 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-15d3f978-0c59-464c-bc24-863366ee9d18 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 6bb99e9b-15af-408e-af01-6e08b8294058] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:51.335909 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-15d3f978-0c59-464c-bc24-863366ee9d18 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:51.336723 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-15d3f978-0c59-464c-bc24-863366ee9d18 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:51.337752 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-15d3f978-0c59-464c-bc24-863366ee9d18 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:51.338402 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-15d3f978-0c59-464c-bc24-863366ee9d18 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:51.398094 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-15d3f978-0c59-464c-bc24-863366ee9d18 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:51.398581 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-15d3f978-0c59-464c-bc24-863366ee9d18 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:51.399054 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.objects.instance [None req-15d3f978-0c59-464c-bc24-863366ee9d18 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lazy-loading 'fault' on Instance uuid 6bb99e9b-15af-408e-af01-6e08b8294058 {{(pid=117722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:05:51.465051 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-15d3f978-0c59-464c-bc24-863366ee9d18 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:51.480211 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-15d3f978-0c59-464c-bc24-863366ee9d18 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058" status: 200 len: 1330 microversion: 2.1 time: 0.166409 May 26 18:05:51.482349 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 307/574] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:05:51 2022] GET /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058 => generated 1330 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:51.517570 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-f306daa3-c573-47f4-8536-563934e2d5c1 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:51.542655 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-f306daa3-c573-47f4-8536-563934e2d5c1 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866" status: 200 len: 1735 microversion: 2.1 time: 0.271130 May 26 18:05:51.543919 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 268/575] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:05:51 2022] GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866 => generated 1735 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:52.507641 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-4657ddf3-d836-4eaf-acf0-ac120b81c69f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:52.509139 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-4657ddf3-d836-4eaf-acf0-ac120b81c69f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 6bb99e9b-15af-408e-af01-6e08b8294058] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:52.516263 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-4657ddf3-d836-4eaf-acf0-ac120b81c69f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:52.516802 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-4657ddf3-d836-4eaf-acf0-ac120b81c69f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:52.517651 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-4657ddf3-d836-4eaf-acf0-ac120b81c69f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:52.518159 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-4657ddf3-d836-4eaf-acf0-ac120b81c69f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:52.533328 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.wsgi [None req-4657ddf3-d836-4eaf-acf0-ac120b81c69f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] HTTP exception thrown: Instance 6bb99e9b-15af-408e-af01-6e08b8294058 could not be found. May 26 18:05:52.535034 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-4657ddf3-d836-4eaf-acf0-ac120b81c69f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Request method failure captured: May 26 18:05:52.535034 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: request: GET /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058 HTTP/1.1 May 26 18:05:52.535034 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Accept: application/json May 26 18:05:52.535034 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Accept-Encoding: identity May 26 18:05:52.535034 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Connection: close May 26 18:05:52.535034 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Content-Length: 0 May 26 18:05:52.535034 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Content-Type: application/json May 26 18:05:52.535034 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Host: 10.222.0.69 May 26 18:05:52.535034 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Openstack-System-Scope: None May 26 18:05:52.535034 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: User-Agent: python-urllib3/1.26.9 May 26 18:05:52.535034 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Auth-Token: gAAAAABij8DD0GGF2lSLDsyvjDvkvKuYTmd8MhBJFcuAgLQjYIxaUzVYvy2y78Ufugs1Oc4LrOO28-M4MWgXvAjDAFM656TsVGzxmhayY-bOw7ExJ5yRcG231tnUdWRr6zrbitvFAB7wzSB1IdWp2Auh8VsxEfhGR0YnizUXC6yVsCWiAksLALA May 26 18:05:52.535034 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Domain-Id: None May 26 18:05:52.535034 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Domain-Name: None May 26 18:05:52.535034 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Identity-Status: Confirmed May 26 18:05:52.535034 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Is-Admin-Project: True May 26 18:05:52.535034 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Domain-Id: default May 26 18:05:52.535034 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Domain-Name: Default May 26 18:05:52.535034 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Id: 8920d2de9dc34386bb0e770f5b51b702 May 26 18:05:52.535034 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Name: tempest-AttachVolumeNegativeTest-2031663802 May 26 18:05:52.535034 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Role: member,reader May 26 18:05:52.535034 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Roles: member,reader May 26 18:05:52.536676 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8920d2de9dc34386bb0e770f5b51b702"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8920d2de9dc34386bb0e770f5b51b702"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8920d2de9dc34386bb0e770f5b51b702"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8920d2de9dc34386bb0e770f5b51b702"}]}] May 26 18:05:52.536676 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant: tempest-AttachVolumeNegativeTest-2031663802 May 26 18:05:52.536676 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant-Id: 8920d2de9dc34386bb0e770f5b51b702 May 26 18:05:52.536676 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2031663802 May 26 18:05:52.536676 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User: tempest-AttachVolumeNegativeTest-2031663802-project May 26 18:05:52.536676 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Domain-Id: default May 26 18:05:52.536676 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Domain-Name: Default May 26 18:05:52.536676 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Id: 2691e1dc96e942b5ba4c726b72a835e9 May 26 18:05:52.536676 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Name: tempest-AttachVolumeNegativeTest-2031663802-project May 26 18:05:52.536676 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: method: > May 26 18:05:52.536676 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: exception: Instance 6bb99e9b-15af-408e-af01-6e08b8294058 could not be found. May 26 18:05:52.536676 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: action_args: {'id': '6bb99e9b-15af-408e-af01-6e08b8294058'} May 26 18:05:52.538106 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:05:52.538106 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:05:52.538106 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:05:52.538106 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:05:52.538106 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:05:52.538106 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:05:52.538106 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:05:52.538106 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:05:52.538106 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:05:52.538106 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:05:52.538106 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bb99e9b-15af-408e-af01-6e08b8294058 could not be found. May 26 18:05:52.538106 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:05:52.538106 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:05:52.538106 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:05:52.538106 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:05:52.538106 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:05:52.538106 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:05:52.538106 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:05:52.538106 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:05:52.538106 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:05:52.541491 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:05:52.541491 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:05:52.541491 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:05:52.541491 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:05:52.541491 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:05:52.541491 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:05:52.541491 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:05:52.541491 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bb99e9b-15af-408e-af01-6e08b8294058 could not be found. May 26 18:05:52.541491 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:05:52.541491 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:05:52.541491 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:05:52.541491 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:05:52.541491 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:05:52.541491 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:05:52.541491 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:05:52.541491 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:05:52.541491 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bb99e9b-15af-408e-af01-6e08b8294058 could not be found. May 26 18:05:52.541491 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:05:52.543183 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-4657ddf3-d836-4eaf-acf0-ac120b81c69f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Returning 404 to user: Instance 6bb99e9b-15af-408e-af01-6e08b8294058 could not be found. {{(pid=117722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:05:52.543183 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-4657ddf3-d836-4eaf-acf0-ac120b81c69f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058" status: 404 len: 111 microversion: 2.1 time: 0.033556 May 26 18:05:52.545621 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-f7c73350-f02e-4e09-8c65-d406fa2ea5a1 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '.version_select at 0x7f3ab8c04940>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:52.552199 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 308/576] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:05:52 2022] GET /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:05:52.560427 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-239da799-bb4c-4a44-88c5-e76c1dcb27ee tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:52.561121 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-239da799-bb4c-4a44-88c5-e76c1dcb27ee tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 704b23df-a1e8-425f-a6bf-4805b1356866] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:52.567764 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-239da799-bb4c-4a44-88c5-e76c1dcb27ee tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:52.569081 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-239da799-bb4c-4a44-88c5-e76c1dcb27ee tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:52.570033 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-239da799-bb4c-4a44-88c5-e76c1dcb27ee tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:52.570643 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-239da799-bb4c-4a44-88c5-e76c1dcb27ee tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:52.592573 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:05:52.613652 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-f7c73350-f02e-4e09-8c65-d406fa2ea5a1 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-64943514" status: 202 len: 0 microversion: 2.1 time: 0.071886 May 26 18:05:52.617687 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 269/577] 10.222.0.69 () {58 vars in 1214 bytes} [Thu May 26 18:05:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-64943514 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:05:52.743412 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-239da799-bb4c-4a44-88c5-e76c1dcb27ee tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:52.757727 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-239da799-bb4c-4a44-88c5-e76c1dcb27ee tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866" status: 200 len: 1735 microversion: 2.1 time: 0.200938 May 26 18:05:52.769115 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 309/578] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:05:52 2022] GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866 => generated 1735 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:53.157277 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-891be7d4-689e-4ae0-a83e-26258d6a9e10 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:53.158039 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-891be7d4-689e-4ae0-a83e-26258d6a9e10 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:53.165492 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-891be7d4-689e-4ae0-a83e-26258d6a9e10 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:53.166202 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-891be7d4-689e-4ae0-a83e-26258d6a9e10 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:53.167367 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-891be7d4-689e-4ae0-a83e-26258d6a9e10 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:53.168111 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-891be7d4-689e-4ae0-a83e-26258d6a9e10 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:53.212958 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-891be7d4-689e-4ae0-a83e-26258d6a9e10 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1/os-volume_attachments/9e863701-bc56-4894-99af-f69645ce8d0e" status: 200 len: 194 microversion: 2.20 time: 0.059440 May 26 18:05:53.213964 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 270/579] 10.222.0.69 () {60 vars in 1453 bytes} [Thu May 26 18:05:53 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1/os-volume_attachments/9e863701-bc56-4894-99af-f69645ce8d0e => generated 194 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 18:05:53.304782 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-f56326b5-ce0e-4645-98d1-d08f1116f3fb tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:53.305453 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-f56326b5-ce0e-4645-98d1-d08f1116f3fb tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:53.313083 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-f56326b5-ce0e-4645-98d1-d08f1116f3fb tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:53.313722 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-f56326b5-ce0e-4645-98d1-d08f1116f3fb tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:53.314633 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-f56326b5-ce0e-4645-98d1-d08f1116f3fb tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:53.315183 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-f56326b5-ce0e-4645-98d1-d08f1116f3fb tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:53.435814 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.objects.instance [None req-f56326b5-ce0e-4645-98d1-d08f1116f3fb tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lazy-loading 'services' on Instance uuid 262a4944-6c10-4122-adce-f7780ff4e7a1 {{(pid=117722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:05:53.478448 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-ffa1a0d4-e0ad-4a78-b3d8-be8765af5532 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:53.479056 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-ffa1a0d4-e0ad-4a78-b3d8-be8765af5532 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:53.486741 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ffa1a0d4-e0ad-4a78-b3d8-be8765af5532 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:53.487795 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ffa1a0d4-e0ad-4a78-b3d8-be8765af5532 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:53.488763 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ffa1a0d4-e0ad-4a78-b3d8-be8765af5532 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:53.489279 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ffa1a0d4-e0ad-4a78-b3d8-be8765af5532 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:53.530223 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-f56326b5-ce0e-4645-98d1-d08f1116f3fb tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "DELETE /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1/os-volume_attachments/9e863701-bc56-4894-99af-f69645ce8d0e" status: 202 len: 0 microversion: 2.20 time: 0.231892 May 26 18:05:53.531160 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 310/580] 10.222.0.69 () {60 vars in 1456 bytes} [Thu May 26 18:05:53 2022] DELETE /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1/os-volume_attachments/9e863701-bc56-4894-99af-f69645ce8d0e => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 26 18:05:53.544717 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-33ff5fe4-f290-4121-b93b-249acc6bd750 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:53.547483 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-33ff5fe4-f290-4121-b93b-249acc6bd750 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:53.565996 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-33ff5fe4-f290-4121-b93b-249acc6bd750 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:53.566505 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-33ff5fe4-f290-4121-b93b-249acc6bd750 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:53.568754 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-33ff5fe4-f290-4121-b93b-249acc6bd750 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:53.569963 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-33ff5fe4-f290-4121-b93b-249acc6bd750 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:53.608063 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.objects.instance [None req-ffa1a0d4-e0ad-4a78-b3d8-be8765af5532 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lazy-loading 'services' on Instance uuid fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7 {{(pid=117723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:05:53.633794 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-33ff5fe4-f290-4121-b93b-249acc6bd750 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.097541 May 26 18:05:53.635234 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 311/581] 10.222.0.69 () {60 vars in 1342 bytes} [Thu May 26 18:05:53 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 18:05:53.711323 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-ffa1a0d4-e0ad-4a78-b3d8-be8765af5532 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "DELETE /compute/v2.1/servers/fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7/os-volume_attachments/4a5f9e32-e491-4a4a-afcf-a38e87c2c87a" status: 202 len: 0 microversion: 2.1 time: 0.238367 May 26 18:05:53.712222 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 271/582] 10.222.0.69 () {58 vars in 1415 bytes} [Thu May 26 18:05:53 2022] DELETE /compute/v2.1/servers/fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7/os-volume_attachments/4a5f9e32-e491-4a4a-afcf-a38e87c2c87a => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 18:05:53.721985 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-84afba07-fa9e-42ad-9420-b42a5ea4f937 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:53.722684 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-84afba07-fa9e-42ad-9420-b42a5ea4f937 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:53.731699 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-84afba07-fa9e-42ad-9420-b42a5ea4f937 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:53.732896 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-84afba07-fa9e-42ad-9420-b42a5ea4f937 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:53.734053 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-84afba07-fa9e-42ad-9420-b42a5ea4f937 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:53.734053 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-84afba07-fa9e-42ad-9420-b42a5ea4f937 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:53.781365 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-84afba07-fa9e-42ad-9420-b42a5ea4f937 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063952 May 26 18:05:53.781953 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 312/583] 10.222.0.69 () {58 vars in 1301 bytes} [Thu May 26 18:05:53 2022] GET /compute/v2.1/servers/fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:05:53.785962 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-5b4e170e-2464-4632-abc3-3bd53ae3c63c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:53.787935 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-5b4e170e-2464-4632-abc3-3bd53ae3c63c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 704b23df-a1e8-425f-a6bf-4805b1356866] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:53.798293 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5b4e170e-2464-4632-abc3-3bd53ae3c63c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:53.798777 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5b4e170e-2464-4632-abc3-3bd53ae3c63c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:53.799598 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5b4e170e-2464-4632-abc3-3bd53ae3c63c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:53.800066 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5b4e170e-2464-4632-abc3-3bd53ae3c63c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:53.964280 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-5b4e170e-2464-4632-abc3-3bd53ae3c63c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:53.972822 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-5b4e170e-2464-4632-abc3-3bd53ae3c63c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866" status: 200 len: 1735 microversion: 2.1 time: 0.197896 May 26 18:05:53.973397 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 272/584] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:05:53 2022] GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866 => generated 1735 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:54.652670 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-f751b0c2-62b4-45ac-a1ae-f8bcc33a6665 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:54.654236 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-f751b0c2-62b4-45ac-a1ae-f8bcc33a6665 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:54.668257 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-f751b0c2-62b4-45ac-a1ae-f8bcc33a6665 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:54.668758 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-f751b0c2-62b4-45ac-a1ae-f8bcc33a6665 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:54.669552 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-f751b0c2-62b4-45ac-a1ae-f8bcc33a6665 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:54.669993 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-f751b0c2-62b4-45ac-a1ae-f8bcc33a6665 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:54.701452 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-f751b0c2-62b4-45ac-a1ae-f8bcc33a6665 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058578 May 26 18:05:54.702071 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 313/585] 10.222.0.69 () {60 vars in 1342 bytes} [Thu May 26 18:05:54 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 18:05:54.793575 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-e407f4c4-9720-4faa-93a7-352624cf81e6 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:54.794573 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-e407f4c4-9720-4faa-93a7-352624cf81e6 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:54.801813 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e407f4c4-9720-4faa-93a7-352624cf81e6 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:54.802279 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e407f4c4-9720-4faa-93a7-352624cf81e6 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:54.803669 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e407f4c4-9720-4faa-93a7-352624cf81e6 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:54.804154 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e407f4c4-9720-4faa-93a7-352624cf81e6 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:54.836980 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-e407f4c4-9720-4faa-93a7-352624cf81e6 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047387 May 26 18:05:54.837564 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 273/586] 10.222.0.69 () {58 vars in 1301 bytes} [Thu May 26 18:05:54 2022] GET /compute/v2.1/servers/fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:05:54.991479 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-82983a28-ab1f-474c-87b9-1ad25fd7bc85 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:54.992109 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-82983a28-ab1f-474c-87b9-1ad25fd7bc85 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 704b23df-a1e8-425f-a6bf-4805b1356866] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:54.998955 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-82983a28-ab1f-474c-87b9-1ad25fd7bc85 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:54.999536 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-82983a28-ab1f-474c-87b9-1ad25fd7bc85 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:55.000425 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-82983a28-ab1f-474c-87b9-1ad25fd7bc85 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:55.000863 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-82983a28-ab1f-474c-87b9-1ad25fd7bc85 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:55.172851 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-82983a28-ab1f-474c-87b9-1ad25fd7bc85 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:55.181691 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-82983a28-ab1f-474c-87b9-1ad25fd7bc85 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866" status: 200 len: 1735 microversion: 2.1 time: 0.194633 May 26 18:05:55.182298 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 314/587] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:05:54 2022] GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866 => generated 1735 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:55.714316 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-3caef21a-bcde-4bd3-8e4f-e5827e109a2c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:55.715231 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-3caef21a-bcde-4bd3-8e4f-e5827e109a2c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:55.721324 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3caef21a-bcde-4bd3-8e4f-e5827e109a2c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:55.721782 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3caef21a-bcde-4bd3-8e4f-e5827e109a2c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:55.722567 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3caef21a-bcde-4bd3-8e4f-e5827e109a2c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:55.723014 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3caef21a-bcde-4bd3-8e4f-e5827e109a2c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:55.759959 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-3caef21a-bcde-4bd3-8e4f-e5827e109a2c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049604 May 26 18:05:55.760849 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 274/588] 10.222.0.69 () {60 vars in 1342 bytes} [Thu May 26 18:05:55 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:55.822135 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-776da0a0-45d1-4762-b8f6-4afb85d7eb3d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:55.822685 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-776da0a0-45d1-4762-b8f6-4afb85d7eb3d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:55.829319 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-776da0a0-45d1-4762-b8f6-4afb85d7eb3d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:55.830088 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-776da0a0-45d1-4762-b8f6-4afb85d7eb3d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:55.830550 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-776da0a0-45d1-4762-b8f6-4afb85d7eb3d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:55.831079 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-776da0a0-45d1-4762-b8f6-4afb85d7eb3d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:55.849403 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-a6db1c15-6052-475c-bf0f-2f6270f5a051 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:55.851527 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-a6db1c15-6052-475c-bf0f-2f6270f5a051 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:55.860190 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a6db1c15-6052-475c-bf0f-2f6270f5a051 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:55.861120 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a6db1c15-6052-475c-bf0f-2f6270f5a051 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:55.862609 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a6db1c15-6052-475c-bf0f-2f6270f5a051 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:55.863468 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-776da0a0-45d1-4762-b8f6-4afb85d7eb3d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Going to try to terminate instance {{(pid=117722) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:05:55.863613 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a6db1c15-6052-475c-bf0f-2f6270f5a051 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:55.901263 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-a6db1c15-6052-475c-bf0f-2f6270f5a051 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056113 May 26 18:05:55.901847 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 275/589] 10.222.0.69 () {58 vars in 1301 bytes} [Thu May 26 18:05:55 2022] GET /compute/v2.1/servers/fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 26 18:05:55.954018 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-776da0a0-45d1-4762-b8f6-4afb85d7eb3d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "DELETE /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 204 len: 0 microversion: 2.20 time: 0.136011 May 26 18:05:55.954955 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 315/590] 10.222.0.69 () {60 vars in 1279 bytes} [Thu May 26 18:05:55 2022] DELETE /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 18:05:55.963893 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-ce900d8b-e7e4-4b4f-a3cf-ca00473210b9 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:55.964628 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-ce900d8b-e7e4-4b4f-a3cf-ca00473210b9 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:55.971133 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ce900d8b-e7e4-4b4f-a3cf-ca00473210b9 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:55.971833 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ce900d8b-e7e4-4b4f-a3cf-ca00473210b9 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:55.973117 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ce900d8b-e7e4-4b4f-a3cf-ca00473210b9 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:55.973967 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ce900d8b-e7e4-4b4f-a3cf-ca00473210b9 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:55.976886 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-b89b0f82-09cc-4424-92a3-7f70a8d1639e tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:55.977891 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-b89b0f82-09cc-4424-92a3-7f70a8d1639e tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:55.988988 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b89b0f82-09cc-4424-92a3-7f70a8d1639e tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:55.989802 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b89b0f82-09cc-4424-92a3-7f70a8d1639e tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:55.991256 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b89b0f82-09cc-4424-92a3-7f70a8d1639e tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:55.992074 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b89b0f82-09cc-4424-92a3-7f70a8d1639e tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:56.042709 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-b89b0f82-09cc-4424-92a3-7f70a8d1639e tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7] Going to try to terminate instance {{(pid=117722) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:05:56.080874 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_cell0:SELECT=4 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:05:56.128367 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-ce900d8b-e7e4-4b4f-a3cf-ca00473210b9 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:56.138736 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-ce900d8b-e7e4-4b4f-a3cf-ca00473210b9 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:56.140912 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-ce900d8b-e7e4-4b4f-a3cf-ca00473210b9 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:56.141263 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-ce900d8b-e7e4-4b4f-a3cf-ca00473210b9 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1723 microversion: 2.20 time: 0.181079 May 26 18:05:56.141825 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 276/591] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:05:55 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:05:56.142285 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-b89b0f82-09cc-4424-92a3-7f70a8d1639e tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "DELETE /compute/v2.1/servers/fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7" status: 204 len: 0 microversion: 2.1 time: 0.174696 May 26 18:05:56.142904 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 316/592] 10.222.0.69 () {58 vars in 1238 bytes} [Thu May 26 18:05:55 2022] DELETE /compute/v2.1/servers/fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 26 18:05:56.157206 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-4453bf66-d7b7-466f-8df1-874ac8b867ed tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:56.157914 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-4453bf66-d7b7-466f-8df1-874ac8b867ed tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:56.165281 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4453bf66-d7b7-466f-8df1-874ac8b867ed tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:56.165738 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4453bf66-d7b7-466f-8df1-874ac8b867ed tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:56.166525 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4453bf66-d7b7-466f-8df1-874ac8b867ed tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:56.166965 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4453bf66-d7b7-466f-8df1-874ac8b867ed tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:56.200244 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-4a311f82-7654-40b9-878a-238a6da1fd9e tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:56.201141 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-4a311f82-7654-40b9-878a-238a6da1fd9e tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 704b23df-a1e8-425f-a6bf-4805b1356866] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:56.207459 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-4a311f82-7654-40b9-878a-238a6da1fd9e tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:56.208000 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-4a311f82-7654-40b9-878a-238a6da1fd9e tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:56.208891 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-4a311f82-7654-40b9-878a-238a6da1fd9e tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:56.209461 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-4a311f82-7654-40b9-878a-238a6da1fd9e tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:56.343750 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-4453bf66-d7b7-466f-8df1-874ac8b867ed tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:56.353592 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-4453bf66-d7b7-466f-8df1-874ac8b867ed tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7" status: 200 len: 1681 microversion: 2.1 time: 0.200514 May 26 18:05:56.354207 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 277/593] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:05:56 2022] GET /compute/v2.1/servers/fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7 => generated 1681 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:05:56.382339 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-4a311f82-7654-40b9-878a-238a6da1fd9e tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:56.391771 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-4a311f82-7654-40b9-878a-238a6da1fd9e tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866" status: 200 len: 1735 microversion: 2.1 time: 0.196080 May 26 18:05:56.392450 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 317/594] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:05:56 2022] GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866 => generated 1735 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:05:57.163265 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-51709c29-8a72-4726-8ffa-3c367a27667b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:57.163968 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-51709c29-8a72-4726-8ffa-3c367a27667b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:57.170668 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-51709c29-8a72-4726-8ffa-3c367a27667b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:57.171265 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-51709c29-8a72-4726-8ffa-3c367a27667b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:57.172234 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-51709c29-8a72-4726-8ffa-3c367a27667b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:57.172699 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-51709c29-8a72-4726-8ffa-3c367a27667b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:57.322819 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-51709c29-8a72-4726-8ffa-3c367a27667b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:57.334766 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-51709c29-8a72-4726-8ffa-3c367a27667b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:57.336613 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-51709c29-8a72-4726-8ffa-3c367a27667b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:57.337825 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-51709c29-8a72-4726-8ffa-3c367a27667b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1723 microversion: 2.20 time: 0.179423 May 26 18:05:57.338691 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 278/595] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:05:57 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:05:57.379533 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-b09c5cf0-55e8-49fc-8ac8-240de471fe81 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:57.380632 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-b09c5cf0-55e8-49fc-8ac8-240de471fe81 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:57.382856 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=1,nova_api:UPDATE=3 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:05:57.390191 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b09c5cf0-55e8-49fc-8ac8-240de471fe81 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:57.390662 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b09c5cf0-55e8-49fc-8ac8-240de471fe81 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:57.391465 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b09c5cf0-55e8-49fc-8ac8-240de471fe81 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:57.391907 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b09c5cf0-55e8-49fc-8ac8-240de471fe81 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:57.410871 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-00a35705-156f-4b77-a641-ab9cb52b882f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:57.411515 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-00a35705-156f-4b77-a641-ab9cb52b882f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 704b23df-a1e8-425f-a6bf-4805b1356866] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:57.419337 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-00a35705-156f-4b77-a641-ab9cb52b882f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:57.419691 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-00a35705-156f-4b77-a641-ab9cb52b882f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:57.420503 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-00a35705-156f-4b77-a641-ab9cb52b882f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:57.420946 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-00a35705-156f-4b77-a641-ab9cb52b882f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:57.548768 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-b09c5cf0-55e8-49fc-8ac8-240de471fe81 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:57.557694 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-b09c5cf0-55e8-49fc-8ac8-240de471fe81 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7" status: 200 len: 1681 microversion: 2.1 time: 0.182090 May 26 18:05:57.558316 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 318/596] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:05:57 2022] GET /compute/v2.1/servers/fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7 => generated 1681 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:57.607606 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-00a35705-156f-4b77-a641-ab9cb52b882f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:57.617995 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-00a35705-156f-4b77-a641-ab9cb52b882f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866" status: 200 len: 1735 microversion: 2.1 time: 0.210951 May 26 18:05:57.618828 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 279/597] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:05:57 2022] GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866 => generated 1735 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:05:58.357967 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-1b6d32ff-bd9c-4f34-9ec0-93c137b6c1c4 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:58.358588 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-1b6d32ff-bd9c-4f34-9ec0-93c137b6c1c4 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:58.365110 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-1b6d32ff-bd9c-4f34-9ec0-93c137b6c1c4 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:58.365600 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-1b6d32ff-bd9c-4f34-9ec0-93c137b6c1c4 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:58.366367 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-1b6d32ff-bd9c-4f34-9ec0-93c137b6c1c4 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:58.366804 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-1b6d32ff-bd9c-4f34-9ec0-93c137b6c1c4 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:58.537376 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-1b6d32ff-bd9c-4f34-9ec0-93c137b6c1c4 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:58.546052 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-1b6d32ff-bd9c-4f34-9ec0-93c137b6c1c4 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:58.547595 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-1b6d32ff-bd9c-4f34-9ec0-93c137b6c1c4 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:58.548824 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-1b6d32ff-bd9c-4f34-9ec0-93c137b6c1c4 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1723 microversion: 2.20 time: 0.194824 May 26 18:05:58.549410 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 319/598] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:05:58 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:05:58.576289 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-0d963382-e730-437f-a4fb-a77bdd698d46 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:58.577103 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-0d963382-e730-437f-a4fb-a77bdd698d46 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:58.585636 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0d963382-e730-437f-a4fb-a77bdd698d46 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:58.586095 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0d963382-e730-437f-a4fb-a77bdd698d46 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:58.586919 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0d963382-e730-437f-a4fb-a77bdd698d46 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:58.587356 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0d963382-e730-437f-a4fb-a77bdd698d46 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:58.650735 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-173f059e-8328-4ae3-a44f-c1a8f5db8347 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:58.651870 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-173f059e-8328-4ae3-a44f-c1a8f5db8347 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 704b23df-a1e8-425f-a6bf-4805b1356866] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:58.662817 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-173f059e-8328-4ae3-a44f-c1a8f5db8347 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:58.664133 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-173f059e-8328-4ae3-a44f-c1a8f5db8347 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:58.665326 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-173f059e-8328-4ae3-a44f-c1a8f5db8347 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:58.665709 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-173f059e-8328-4ae3-a44f-c1a8f5db8347 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:58.749216 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-0d963382-e730-437f-a4fb-a77bdd698d46 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:58.759130 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-0d963382-e730-437f-a4fb-a77bdd698d46 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7" status: 200 len: 1681 microversion: 2.1 time: 0.186800 May 26 18:05:58.759735 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 280/599] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:05:58 2022] GET /compute/v2.1/servers/fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7 => generated 1681 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:58.830329 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-173f059e-8328-4ae3-a44f-c1a8f5db8347 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:58.841338 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-173f059e-8328-4ae3-a44f-c1a8f5db8347 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866" status: 200 len: 1735 microversion: 2.1 time: 0.198242 May 26 18:05:58.842318 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 320/600] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:05:58 2022] GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866 => generated 1735 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:05:59.568936 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-ad5cbbc0-6d59-4a60-8f8b-47775ffa4cc7 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:59.569689 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-ad5cbbc0-6d59-4a60-8f8b-47775ffa4cc7 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:59.576934 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ad5cbbc0-6d59-4a60-8f8b-47775ffa4cc7 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:59.577931 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ad5cbbc0-6d59-4a60-8f8b-47775ffa4cc7 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:59.578698 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ad5cbbc0-6d59-4a60-8f8b-47775ffa4cc7 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:59.579375 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ad5cbbc0-6d59-4a60-8f8b-47775ffa4cc7 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:59.782587 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-571eabfe-8213-4771-9dc6-d6d8cf328aa3 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:59.783796 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-571eabfe-8213-4771-9dc6-d6d8cf328aa3 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:59.795485 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-571eabfe-8213-4771-9dc6-d6d8cf328aa3 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:59.796047 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-571eabfe-8213-4771-9dc6-d6d8cf328aa3 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:59.797702 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-571eabfe-8213-4771-9dc6-d6d8cf328aa3 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:59.798660 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-571eabfe-8213-4771-9dc6-d6d8cf328aa3 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:59.840234 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-ad5cbbc0-6d59-4a60-8f8b-47775ffa4cc7 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:59.853442 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-ad5cbbc0-6d59-4a60-8f8b-47775ffa4cc7 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:59.856951 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-ad5cbbc0-6d59-4a60-8f8b-47775ffa4cc7 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:59.859600 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-ad5cbbc0-6d59-4a60-8f8b-47775ffa4cc7 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1723 microversion: 2.20 time: 0.296121 May 26 18:05:59.860683 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 281/601] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:05:59 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1723 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:05:59.887535 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-7c390f45-1087-48f5-ad05-8611233e8c88 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:59.892698 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-7c390f45-1087-48f5-ad05-8611233e8c88 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 704b23df-a1e8-425f-a6bf-4805b1356866] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:59.903491 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7c390f45-1087-48f5-ad05-8611233e8c88 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:59.904489 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7c390f45-1087-48f5-ad05-8611233e8c88 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:59.905587 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7c390f45-1087-48f5-ad05-8611233e8c88 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:59.906473 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7c390f45-1087-48f5-ad05-8611233e8c88 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:00.033759 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-571eabfe-8213-4771-9dc6-d6d8cf328aa3 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:00.049724 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-571eabfe-8213-4771-9dc6-d6d8cf328aa3 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7" status: 200 len: 1681 microversion: 2.1 time: 0.274235 May 26 18:06:00.050783 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 321/602] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:05:59 2022] GET /compute/v2.1/servers/fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7 => generated 1681 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:00.156160 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-7c390f45-1087-48f5-ad05-8611233e8c88 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:00.165061 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-7c390f45-1087-48f5-ad05-8611233e8c88 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866" status: 200 len: 1735 microversion: 2.1 time: 0.285578 May 26 18:06:00.165892 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 282/603] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:05:59 2022] GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866 => generated 1735 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:00.776744 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [req-16632f21-297a-4899-94c9-a8319866205b req-0093f031-7f99-467c-b466-1a34a9f7eaa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "262a4944-6c10-4122-adce-f7780ff4e7a1", "name": "network-vif-deleted", "tag": "0450cfd2-c365-4788-a3b6-a839770208e7"}]} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:06:00.797299 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-16632f21-297a-4899-94c9-a8319866205b req-0093f031-7f99-467c-b466-1a34a9f7eaa0 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:00.798570 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-16632f21-297a-4899-94c9-a8319866205b req-0093f031-7f99-467c-b466-1a34a9f7eaa0 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:00.805363 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:00.815925 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.compute.server_external_events [req-16632f21-297a-4899-94c9-a8319866205b req-0093f031-7f99-467c-b466-1a34a9f7eaa0 service nova] Creating event network-vif-deleted:0450cfd2-c365-4788-a3b6-a839770208e7 for instance 262a4944-6c10-4122-adce-f7780ff4e7a1 on hv-cinder-83607 May 26 18:06:00.825023 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [req-16632f21-297a-4899-94c9-a8319866205b req-0093f031-7f99-467c-b466-1a34a9f7eaa0 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075960 May 26 18:06:00.826316 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 322/604] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:06:00.887415 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-737dbc57-5db4-4975-965e-8bfd382ed826 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:00.888732 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-737dbc57-5db4-4975-965e-8bfd382ed826 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:00.908825 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-737dbc57-5db4-4975-965e-8bfd382ed826 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:00.910128 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-737dbc57-5db4-4975-965e-8bfd382ed826 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:00.914981 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-737dbc57-5db4-4975-965e-8bfd382ed826 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:00.916582 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-737dbc57-5db4-4975-965e-8bfd382ed826 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:00.951505 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:00.972146 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-737dbc57-5db4-4975-965e-8bfd382ed826 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:00.972985 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-737dbc57-5db4-4975-965e-8bfd382ed826 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:00.973917 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.objects.instance [None req-737dbc57-5db4-4975-965e-8bfd382ed826 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lazy-loading 'fault' on Instance uuid 262a4944-6c10-4122-adce-f7780ff4e7a1 {{(pid=117723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:06:01.056055 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-737dbc57-5db4-4975-965e-8bfd382ed826 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:01.069401 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-99c6ea48-1666-4d04-9046-fbe04f3e9977 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:01.070662 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-99c6ea48-1666-4d04-9046-fbe04f3e9977 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:01.078020 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-99c6ea48-1666-4d04-9046-fbe04f3e9977 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:01.078277 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-737dbc57-5db4-4975-965e-8bfd382ed826 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:01.078979 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-99c6ea48-1666-4d04-9046-fbe04f3e9977 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:01.080096 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-99c6ea48-1666-4d04-9046-fbe04f3e9977 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:01.080915 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-99c6ea48-1666-4d04-9046-fbe04f3e9977 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:01.081832 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-737dbc57-5db4-4975-965e-8bfd382ed826 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:01.085498 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-737dbc57-5db4-4975-965e-8bfd382ed826 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 200 len: 1370 microversion: 2.20 time: 0.205691 May 26 18:06:01.086474 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 283/605] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:06:00 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 1370 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:06:01.195875 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-c2a52dce-07e0-44ed-b9e2-a4f2517d135f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:01.197851 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-c2a52dce-07e0-44ed-b9e2-a4f2517d135f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 704b23df-a1e8-425f-a6bf-4805b1356866] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:01.207489 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_api:SELECT=59,nova_api:DELETE=1 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:01.211578 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c2a52dce-07e0-44ed-b9e2-a4f2517d135f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:01.212927 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c2a52dce-07e0-44ed-b9e2-a4f2517d135f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:01.214814 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c2a52dce-07e0-44ed-b9e2-a4f2517d135f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:01.215874 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c2a52dce-07e0-44ed-b9e2-a4f2517d135f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:01.280929 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-99c6ea48-1666-4d04-9046-fbe04f3e9977 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:01.292662 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-99c6ea48-1666-4d04-9046-fbe04f3e9977 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7" status: 200 len: 1681 microversion: 2.1 time: 0.227566 May 26 18:06:01.293264 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 323/606] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:06:01 2022] GET /compute/v2.1/servers/fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7 => generated 1681 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:06:01.738690 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-c2a52dce-07e0-44ed-b9e2-a4f2517d135f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:01.749608 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-c2a52dce-07e0-44ed-b9e2-a4f2517d135f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866" status: 200 len: 1735 microversion: 2.1 time: 0.569917 May 26 18:06:01.750508 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 284/607] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:06:01 2022] GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866 => generated 1735 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:02.114345 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-5a8b99ad-6c4f-442b-8704-e42a858eda04 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:02.115156 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-5a8b99ad-6c4f-442b-8704-e42a858eda04 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:02.122586 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-5a8b99ad-6c4f-442b-8704-e42a858eda04 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:02.123034 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-5a8b99ad-6c4f-442b-8704-e42a858eda04 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:02.124037 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-5a8b99ad-6c4f-442b-8704-e42a858eda04 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:02.124468 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-5a8b99ad-6c4f-442b-8704-e42a858eda04 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:02.145325 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.wsgi [None req-5a8b99ad-6c4f-442b-8704-e42a858eda04 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] HTTP exception thrown: Instance 262a4944-6c10-4122-adce-f7780ff4e7a1 could not be found. May 26 18:06:02.150473 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-5a8b99ad-6c4f-442b-8704-e42a858eda04 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Request method failure captured: May 26 18:06:02.150473 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: request: GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 HTTP/1.1 May 26 18:06:02.150473 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Accept: application/json May 26 18:06:02.150473 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Accept-Encoding: identity May 26 18:06:02.150473 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Connection: close May 26 18:06:02.150473 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Content-Length: 0 May 26 18:06:02.150473 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Content-Type: application/json May 26 18:06:02.150473 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Host: 10.222.0.69 May 26 18:06:02.150473 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Openstack-System-Scope: None May 26 18:06:02.150473 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: User-Agent: python-urllib3/1.26.9 May 26 18:06:02.150473 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Auth-Token: gAAAAABij8BxpRwTq7ns-P1wYkedfpUueW3mAZi146E49MBrQ_ICTX574bgnFIcC8JTKOw16HbsXCxOVP8oC3ujHZDcUtuY8bGCGXJLA59VsbX0GKxw_BxOB2yV02HgVRzSAEwJUf8s8wVVFhuzNpi-dqbuUucVqkN7s1q3u97eu3bftR_HKDsA May 26 18:06:02.150473 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Domain-Id: None May 26 18:06:02.150473 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Domain-Name: None May 26 18:06:02.150473 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Identity-Status: Confirmed May 26 18:06:02.150473 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Is-Admin-Project: True May 26 18:06:02.150473 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Openstack-Nova-Api-Version: 2.20 May 26 18:06:02.150473 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Domain-Id: default May 26 18:06:02.150473 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Domain-Name: Default May 26 18:06:02.150473 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Id: ab53cc69f7b0424cb689317c4be9b685 May 26 18:06:02.150473 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1834557193 May 26 18:06:02.150473 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Role: member,reader May 26 18:06:02.150473 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Roles: member,reader May 26 18:06:02.156847 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ab53cc69f7b0424cb689317c4be9b685"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ab53cc69f7b0424cb689317c4be9b685"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ab53cc69f7b0424cb689317c4be9b685"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ab53cc69f7b0424cb689317c4be9b685"}]}] May 26 18:06:02.156847 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1834557193 May 26 18:06:02.156847 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant-Id: ab53cc69f7b0424cb689317c4be9b685 May 26 18:06:02.156847 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1834557193 May 26 18:06:02.156847 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User: tempest-AttachVolumeShelveTestJSON-1834557193-project May 26 18:06:02.156847 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Domain-Id: default May 26 18:06:02.156847 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Domain-Name: Default May 26 18:06:02.156847 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Id: a7cc6fcd7b4c4cee8d21e2692757aaf6 May 26 18:06:02.156847 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1834557193-project May 26 18:06:02.156847 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: method: > May 26 18:06:02.156847 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: exception: Instance 262a4944-6c10-4122-adce-f7780ff4e7a1 could not be found. May 26 18:06:02.156847 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: action_args: {'id': '262a4944-6c10-4122-adce-f7780ff4e7a1'} May 26 18:06:02.158233 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:06:02.158233 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:06:02.158233 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:06:02.158233 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:06:02.158233 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:06:02.158233 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:06:02.158233 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:06:02.158233 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:06:02.158233 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:06:02.158233 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:06:02.158233 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 262a4944-6c10-4122-adce-f7780ff4e7a1 could not be found. May 26 18:06:02.158233 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:06:02.158233 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:06:02.158233 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:06:02.158233 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:06:02.158233 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:06:02.158233 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:06:02.158233 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:06:02.158233 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:06:02.158233 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:06:02.161244 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:06:02.161244 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:06:02.161244 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:06:02.161244 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:06:02.161244 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:06:02.161244 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:06:02.161244 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:06:02.161244 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 262a4944-6c10-4122-adce-f7780ff4e7a1 could not be found. May 26 18:06:02.161244 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:06:02.161244 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:06:02.161244 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:06:02.161244 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:06:02.161244 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:06:02.161244 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:06:02.161244 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:06:02.161244 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:06:02.161244 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 262a4944-6c10-4122-adce-f7780ff4e7a1 could not be found. May 26 18:06:02.161244 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:06:02.163572 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-5a8b99ad-6c4f-442b-8704-e42a858eda04 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Returning 404 to user: Instance 262a4944-6c10-4122-adce-f7780ff4e7a1 could not be found. {{(pid=117722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:06:02.163572 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-5a8b99ad-6c4f-442b-8704-e42a858eda04 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 404 len: 111 microversion: 2.20 time: 0.039514 May 26 18:06:02.163572 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 324/608] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:06:02 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 18:06:02.168093 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-ac9fb116-f6c7-4d64-a08c-1264de0fba62 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '.version_select at 0x7f3ab8cabca0>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:02.189378 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-ac9fb116-f6c7-4d64-a08c-1264de0fba62 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-19181237" status: 204 len: 0 microversion: 2.20 time: 0.033647 May 26 18:06:02.201490 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 285/609] 10.222.0.69 () {60 vars in 1255 bytes} [Thu May 26 18:06:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-19181237 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 18:06:02.325235 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-37f05b15-76d2-4904-89bd-d883baf7b583 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:02.325905 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-37f05b15-76d2-4904-89bd-d883baf7b583 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:02.339517 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-37f05b15-76d2-4904-89bd-d883baf7b583 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:02.339966 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-37f05b15-76d2-4904-89bd-d883baf7b583 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:02.340781 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-37f05b15-76d2-4904-89bd-d883baf7b583 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:02.341218 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-37f05b15-76d2-4904-89bd-d883baf7b583 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:02.407724 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-37f05b15-76d2-4904-89bd-d883baf7b583 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:02.408260 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-37f05b15-76d2-4904-89bd-d883baf7b583 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:02.408724 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.objects.instance [None req-37f05b15-76d2-4904-89bd-d883baf7b583 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lazy-loading 'fault' on Instance uuid fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7 {{(pid=117722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:06:02.482358 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-37f05b15-76d2-4904-89bd-d883baf7b583 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:02.494934 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-37f05b15-76d2-4904-89bd-d883baf7b583 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7" status: 200 len: 1331 microversion: 2.1 time: 0.176823 May 26 18:06:02.496327 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 325/610] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:06:02 2022] GET /compute/v2.1/servers/fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7 => generated 1331 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:02.798441 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-649d9900-5376-458a-b203-6761f3bf3548 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:02.802153 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-649d9900-5376-458a-b203-6761f3bf3548 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 704b23df-a1e8-425f-a6bf-4805b1356866] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:02.831209 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-649d9900-5376-458a-b203-6761f3bf3548 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:02.831909 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-649d9900-5376-458a-b203-6761f3bf3548 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:02.833207 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-649d9900-5376-458a-b203-6761f3bf3548 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:02.842681 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-649d9900-5376-458a-b203-6761f3bf3548 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:02.850586 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [req-db509083-dd6b-4f40-aefb-0fe622f5e441 req-8d09912b-1b03-4496-b02e-69fec5f51408 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7", "name": "network-vif-deleted", "tag": "ce4a9d70-264c-4cdc-a8ce-2911a9f3ec0c"}]} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:06:02.863934 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-db509083-dd6b-4f40-aefb-0fe622f5e441 req-8d09912b-1b03-4496-b02e-69fec5f51408 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:02.866275 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-db509083-dd6b-4f40-aefb-0fe622f5e441 req-8d09912b-1b03-4496-b02e-69fec5f51408 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:02.883268 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.compute.server_external_events [req-db509083-dd6b-4f40-aefb-0fe622f5e441 req-8d09912b-1b03-4496-b02e-69fec5f51408 service nova] Creating event network-vif-deleted:ce4a9d70-264c-4cdc-a8ce-2911a9f3ec0c for instance fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7 on hv-cinder-83607 May 26 18:06:02.891666 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [req-db509083-dd6b-4f40-aefb-0fe622f5e441 req-8d09912b-1b03-4496-b02e-69fec5f51408 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045982 May 26 18:06:02.893192 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 326/611] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:06:03.148206 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-649d9900-5376-458a-b203-6761f3bf3548 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:03.168119 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-4302670d-57b9-4f4e-a2fd-fd3d1e83bdd6 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Action: 'create', calling method: .version_select at 0x7f3ab8ada9d0>, body: {"keypair": {"name": "tempest-keypair-1559838106", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCzVlcmDxjR2fTeIX5MD6lO83JIDybN5O3B0XsU4Er0zG+TAbBeuStmTPKSEuO27ZEWoBXFM8vGb5KiylCB3VZcPX7Yk4za7VlFudLM0oyuufEPjGx1X76/AjQfsr49/Q=="}} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:06:03.170240 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-649d9900-5376-458a-b203-6761f3bf3548 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866" status: 200 len: 1715 microversion: 2.1 time: 0.401180 May 26 18:06:03.172540 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 286/612] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:06:02 2022] GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866 => generated 1715 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:03.197812 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.quota [None req-4302670d-57b9-4f4e-a2fd-fd3d1e83bdd6 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Getting quotas for project ab53cc69f7b0424cb689317c4be9b685. Resources: {'key_pairs'} {{(pid=117722) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:06:03.208192 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.quota [None req-4302670d-57b9-4f4e-a2fd-fd3d1e83bdd6 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Getting quotas for user a7cc6fcd7b4c4cee8d21e2692757aaf6 and project ab53cc69f7b0424cb689317c4be9b685. Resources: {'key_pairs'} {{(pid=117722) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:06:03.252610 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-4302670d-57b9-4f4e-a2fd-fd3d1e83bdd6 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.093398 May 26 18:06:03.256675 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 327/613] 10.222.0.69 () {62 vars in 1199 bytes} [Thu May 26 18:06:03 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 99 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) May 26 18:06:03.323899 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-309c8237-3a86-4d35-ba21-82a9b00ea7f5 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:03.324457 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-309c8237-3a86-4d35-ba21-82a9b00ea7f5 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 704b23df-a1e8-425f-a6bf-4805b1356866] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:03.337523 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-309c8237-3a86-4d35-ba21-82a9b00ea7f5 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:03.338014 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-309c8237-3a86-4d35-ba21-82a9b00ea7f5 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:03.338829 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-309c8237-3a86-4d35-ba21-82a9b00ea7f5 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:03.339346 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-309c8237-3a86-4d35-ba21-82a9b00ea7f5 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:03.459327 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.wsgi [None req-309c8237-3a86-4d35-ba21-82a9b00ea7f5 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] HTTP exception thrown: Cannot 'detach_volume' instance 704b23df-a1e8-425f-a6bf-4805b1356866 while it is in vm_state rescued May 26 18:06:03.461288 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-309c8237-3a86-4d35-ba21-82a9b00ea7f5 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Request method failure captured: May 26 18:06:03.461288 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: request: DELETE /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866/os-volume_attachments/90236f05-8d50-4481-aa60-e8f63e231893 HTTP/1.1 May 26 18:06:03.461288 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Accept: application/json May 26 18:06:03.461288 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Accept-Encoding: identity May 26 18:06:03.461288 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Connection: close May 26 18:06:03.461288 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Content-Length: 0 May 26 18:06:03.461288 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Content-Type: application/json May 26 18:06:03.461288 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Host: 10.222.0.69 May 26 18:06:03.461288 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Openstack-System-Scope: None May 26 18:06:03.461288 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: User-Agent: python-urllib3/1.26.9 May 26 18:06:03.461288 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Auth-Token: gAAAAABij8CEaLy0mIY1rbl58rC9P5zQJt3SdA29iT72yPdbP2A1cZkxmYRESeVBN9npB9Fyh-TEA-fQEqHl8bqgiGsn4EJRSEgZQOIOcnpWWnEUJaD6JqRSmdBSMdFWgTLV5TzEuYe-QdEGVEJ4qH0zXg8eK_viVaqviW5ytzmptISabYMrRrw May 26 18:06:03.461288 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Domain-Id: None May 26 18:06:03.461288 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Domain-Name: None May 26 18:06:03.461288 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Identity-Status: Confirmed May 26 18:06:03.461288 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Is-Admin-Project: True May 26 18:06:03.461288 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Domain-Id: default May 26 18:06:03.461288 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Domain-Name: Default May 26 18:06:03.461288 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Id: 53288d567a8f426bb068908db481e32e May 26 18:06:03.461288 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-48273316 May 26 18:06:03.461288 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Role: member,reader May 26 18:06:03.461288 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Roles: member,reader May 26 18:06:03.462635 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/53288d567a8f426bb068908db481e32e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/53288d567a8f426bb068908db481e32e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/53288d567a8f426bb068908db481e32e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_53288d567a8f426bb068908db481e32e"}]}] May 26 18:06:03.462635 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant: tempest-ServerRescueNegativeTestJSON-48273316 May 26 18:06:03.462635 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant-Id: 53288d567a8f426bb068908db481e32e May 26 18:06:03.462635 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-48273316 May 26 18:06:03.462635 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User: tempest-ServerRescueNegativeTestJSON-48273316-project May 26 18:06:03.462635 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Domain-Id: default May 26 18:06:03.462635 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Domain-Name: Default May 26 18:06:03.462635 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Id: 5b5c8dedd274447da8ee4600feb6a26c May 26 18:06:03.462635 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Name: tempest-ServerRescueNegativeTestJSON-48273316-project May 26 18:06:03.462635 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: method: > May 26 18:06:03.462635 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: exception: Cannot 'detach_volume' instance 704b23df-a1e8-425f-a6bf-4805b1356866 while it is in vm_state rescued May 26 18:06:03.463519 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: action_args: {'server_id': '704b23df-a1e8-425f-a6bf-4805b1356866', 'id': '90236f05-8d50-4481-aa60-e8f63e231893'} May 26 18:06:03.463519 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:06:03.463519 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:06:03.463519 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 26 18:06:03.463519 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 26 18:06:03.463519 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 18:06:03.463519 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 18:06:03.463519 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 26 18:06:03.463519 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 26 18:06:03.463519 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 704b23df-a1e8-425f-a6bf-4805b1356866 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 26 18:06:03.463519 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:06:03.463519 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:06:03.463519 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:06:03.463519 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:06:03.463519 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:06:03.463519 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:06:03.463519 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:06:03.463519 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:06:03.463519 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:06:03.463519 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:06:03.465225 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 26 18:06:03.465225 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 26 18:06:03.465225 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 26 18:06:03.465225 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 26 18:06:03.465225 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 704b23df-a1e8-425f-a6bf-4805b1356866 while it is in vm_state rescued May 26 18:06:03.465225 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:06:03.465225 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:06:03.465225 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:06:03.465225 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:06:03.465225 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:06:03.465225 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:06:03.465225 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:06:03.465225 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:06:03.465225 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 704b23df-a1e8-425f-a6bf-4805b1356866 while it is in vm_state rescued May 26 18:06:03.465225 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:06:03.465225 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-309c8237-3a86-4d35-ba21-82a9b00ea7f5 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Returning 409 to user: Cannot 'detach_volume' instance 704b23df-a1e8-425f-a6bf-4805b1356866 while it is in vm_state rescued {{(pid=117723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:06:03.466309 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-309c8237-3a86-4d35-ba21-82a9b00ea7f5 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "DELETE /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866/os-volume_attachments/90236f05-8d50-4481-aa60-e8f63e231893" status: 409 len: 152 microversion: 2.1 time: 0.143491 May 26 18:06:03.467478 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 287/614] 10.222.0.69 () {58 vars in 1415 bytes} [Thu May 26 18:06:03 2022] DELETE /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866/os-volume_attachments/90236f05-8d50-4481-aa60-e8f63e231893 => generated 152 bytes in 149 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 26 18:06:03.481792 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-7f2eca68-9e1f-4217-a8bc-f3c4f816e846 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:06:03.481792 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-7f2eca68-9e1f-4217-a8bc-f3c4f816e846 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 704b23df-a1e8-425f-a6bf-4805b1356866] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:03.488556 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7f2eca68-9e1f-4217-a8bc-f3c4f816e846 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:03.489002 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7f2eca68-9e1f-4217-a8bc-f3c4f816e846 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:03.489965 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7f2eca68-9e1f-4217-a8bc-f3c4f816e846 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:03.491126 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7f2eca68-9e1f-4217-a8bc-f3c4f816e846 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:03.516869 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-8614e31e-7d9a-4a71-84d3-9d002deb17ec tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:03.518134 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-8614e31e-7d9a-4a71-84d3-9d002deb17ec tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:03.532892 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8614e31e-7d9a-4a71-84d3-9d002deb17ec tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:03.533897 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8614e31e-7d9a-4a71-84d3-9d002deb17ec tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:03.535005 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8614e31e-7d9a-4a71-84d3-9d002deb17ec tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:03.536304 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8614e31e-7d9a-4a71-84d3-9d002deb17ec tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:03.563139 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.wsgi [None req-8614e31e-7d9a-4a71-84d3-9d002deb17ec tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] HTTP exception thrown: Instance fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7 could not be found. May 26 18:06:03.565934 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-8614e31e-7d9a-4a71-84d3-9d002deb17ec tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Request method failure captured: May 26 18:06:03.565934 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: request: GET /compute/v2.1/servers/fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7 HTTP/1.1 May 26 18:06:03.565934 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Accept: application/json May 26 18:06:03.565934 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Accept-Encoding: identity May 26 18:06:03.565934 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Connection: close May 26 18:06:03.565934 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Content-Length: 0 May 26 18:06:03.565934 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Content-Type: application/json May 26 18:06:03.565934 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Host: 10.222.0.69 May 26 18:06:03.565934 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Openstack-System-Scope: None May 26 18:06:03.565934 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: User-Agent: python-urllib3/1.26.9 May 26 18:06:03.565934 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Auth-Token: gAAAAABij8DD0GGF2lSLDsyvjDvkvKuYTmd8MhBJFcuAgLQjYIxaUzVYvy2y78Ufugs1Oc4LrOO28-M4MWgXvAjDAFM656TsVGzxmhayY-bOw7ExJ5yRcG231tnUdWRr6zrbitvFAB7wzSB1IdWp2Auh8VsxEfhGR0YnizUXC6yVsCWiAksLALA May 26 18:06:03.565934 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Domain-Id: None May 26 18:06:03.565934 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Domain-Name: None May 26 18:06:03.565934 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Identity-Status: Confirmed May 26 18:06:03.565934 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Is-Admin-Project: True May 26 18:06:03.565934 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Domain-Id: default May 26 18:06:03.565934 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Domain-Name: Default May 26 18:06:03.565934 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Id: 8920d2de9dc34386bb0e770f5b51b702 May 26 18:06:03.565934 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Name: tempest-AttachVolumeNegativeTest-2031663802 May 26 18:06:03.565934 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Role: member,reader May 26 18:06:03.565934 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Roles: member,reader May 26 18:06:03.567568 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8920d2de9dc34386bb0e770f5b51b702"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8920d2de9dc34386bb0e770f5b51b702"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8920d2de9dc34386bb0e770f5b51b702"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8920d2de9dc34386bb0e770f5b51b702"}]}] May 26 18:06:03.567568 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant: tempest-AttachVolumeNegativeTest-2031663802 May 26 18:06:03.567568 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant-Id: 8920d2de9dc34386bb0e770f5b51b702 May 26 18:06:03.567568 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2031663802 May 26 18:06:03.567568 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User: tempest-AttachVolumeNegativeTest-2031663802-project May 26 18:06:03.567568 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Domain-Id: default May 26 18:06:03.567568 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Domain-Name: Default May 26 18:06:03.567568 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Id: 2691e1dc96e942b5ba4c726b72a835e9 May 26 18:06:03.567568 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Name: tempest-AttachVolumeNegativeTest-2031663802-project May 26 18:06:03.567568 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: method: > May 26 18:06:03.567568 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: exception: Instance fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7 could not be found. May 26 18:06:03.567568 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: action_args: {'id': 'fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7'} May 26 18:06:03.568925 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:06:03.568925 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:06:03.568925 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:06:03.568925 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:06:03.568925 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:06:03.568925 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:06:03.568925 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:06:03.568925 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:06:03.568925 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:06:03.568925 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:06:03.568925 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7 could not be found. May 26 18:06:03.568925 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:06:03.568925 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:06:03.568925 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:06:03.568925 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:06:03.568925 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:06:03.568925 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:06:03.568925 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:06:03.568925 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:06:03.568925 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:06:03.570738 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:06:03.570738 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:06:03.570738 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:06:03.570738 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:06:03.570738 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:06:03.570738 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:06:03.570738 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:06:03.570738 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7 could not be found. May 26 18:06:03.570738 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:06:03.570738 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:06:03.570738 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:06:03.570738 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:06:03.570738 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:06:03.570738 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:06:03.570738 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:06:03.570738 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:06:03.570738 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7 could not be found. May 26 18:06:03.570738 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:06:03.574946 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-8614e31e-7d9a-4a71-84d3-9d002deb17ec tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Returning 404 to user: Instance fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7 could not be found. {{(pid=117723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:06:03.575892 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-8614e31e-7d9a-4a71-84d3-9d002deb17ec tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7" status: 404 len: 111 microversion: 2.1 time: 0.064551 May 26 18:06:03.580708 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 288/615] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:06:03 2022] GET /compute/v2.1/servers/fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:06:03.589230 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-f4a53869-0d4d-4192-8ad1-068aabee5e8b tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '.version_select at 0x7f3ab8bedf70>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:03.613182 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-f4a53869-0d4d-4192-8ad1-068aabee5e8b tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-689133379" status: 202 len: 0 microversion: 2.1 time: 0.030070 May 26 18:06:03.614317 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 289/616] 10.222.0.69 () {58 vars in 1217 bytes} [Thu May 26 18:06:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-689133379 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 18:06:03.634504 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-7f2eca68-9e1f-4217-a8bc-f3c4f816e846 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "POST /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866/action" status: 202 len: 0 microversion: 2.1 time: 0.157791 May 26 18:06:03.636073 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 328/617] 10.222.0.69 () {60 vars in 1277 bytes} [Thu May 26 18:06:03 2022] POST /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 18:06:03.644488 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-355984ea-2969-48f4-b759-bf7badb2c69e tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:03.645098 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-355984ea-2969-48f4-b759-bf7badb2c69e tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 704b23df-a1e8-425f-a6bf-4805b1356866] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:03.653609 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-355984ea-2969-48f4-b759-bf7badb2c69e tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:03.654066 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-355984ea-2969-48f4-b759-bf7badb2c69e tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:03.655004 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-355984ea-2969-48f4-b759-bf7badb2c69e tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:03.655377 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-355984ea-2969-48f4-b759-bf7badb2c69e tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:03.969579 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-355984ea-2969-48f4-b759-bf7badb2c69e tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:03.981781 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-355984ea-2969-48f4-b759-bf7badb2c69e tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866" status: 200 len: 1723 microversion: 2.1 time: 0.340796 May 26 18:06:03.983315 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 290/618] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:06:03 2022] GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866 => generated 1723 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:04.051794 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-cd6a1954-8dcd-4d63-8c75-ef0d160147fc tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1781651439", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-388820237", "security_groups": [{"name": "tempest-secgroup-smoke-714810901"}], "block_device_mapping_v2": [{"uuid": "4d0880ce-2ee1-4d76-944b-b39532fe306e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7d5a4e77-6968-4ef2-a95a-0d27f89b0d76"}]}} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:06:04.354869 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.network.neutron [None req-cd6a1954-8dcd-4d63-8c75-ef0d160147fc tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] validate_networks() for [('7d5a4e77-6968-4ef2-a95a-0d27f89b0d76', None, None, None, None, None)] {{(pid=117722) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:06:04.969304 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-850716d4-d5ed-4de8-9d57-0c3e890e4328 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Action: 'create', calling method: .version_select at 0x7f3ab8e139d0>, body: {"keypair": {"name": "tempest-keypair-525900821", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHPteIYzihhWTW6ZvvQs3U7TQUJzZqucyxGnp/Tmlz1Tlk4l2vPult/N18p/ydTRgOgd6sa3PfBTncVKD3DNrw9bi4mUyfVosfGmPwsRkPdMxuSNEPvjmWZo1LKXRK8zjw=="}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:06:04.992947 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-850716d4-d5ed-4de8-9d57-0c3e890e4328 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Getting quotas for project 8920d2de9dc34386bb0e770f5b51b702. Resources: {'key_pairs'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:06:04.998983 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-850716d4-d5ed-4de8-9d57-0c3e890e4328 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Getting quotas for user 2691e1dc96e942b5ba4c726b72a835e9 and project 8920d2de9dc34386bb0e770f5b51b702. Resources: {'key_pairs'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:06:05.029039 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-850716d4-d5ed-4de8-9d57-0c3e890e4328 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.063631 May 26 18:06:05.029569 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 291/619] 10.222.0.69 () {60 vars in 1158 bytes} [Thu May 26 18:06:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:06:05.036221 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-b6cee0be-4d46-471f-a6ca-6f9497f83e6c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:05.036221 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-b6cee0be-4d46-471f-a6ca-6f9497f83e6c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 704b23df-a1e8-425f-a6bf-4805b1356866] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:05.044198 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b6cee0be-4d46-471f-a6ca-6f9497f83e6c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:05.044692 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b6cee0be-4d46-471f-a6ca-6f9497f83e6c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:05.045508 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b6cee0be-4d46-471f-a6ca-6f9497f83e6c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:05.046042 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b6cee0be-4d46-471f-a6ca-6f9497f83e6c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:05.285256 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-b6cee0be-4d46-471f-a6ca-6f9497f83e6c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:05.303418 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-b6cee0be-4d46-471f-a6ca-6f9497f83e6c tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866" status: 200 len: 1723 microversion: 2.1 time: 0.272599 May 26 18:06:05.304597 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 292/620] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:06:05 2022] GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866 => generated 1723 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:05.324234 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.virt.hardware [None req-cd6a1954-8dcd-4d63-8c75-ef0d160147fc tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Flavor limits 0:0:0 {{(pid=117722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:06:05.325547 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.virt.hardware [None req-cd6a1954-8dcd-4d63-8c75-ef0d160147fc tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Image limits 0:0:0 {{(pid=117722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:06:05.326429 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.virt.hardware [None req-cd6a1954-8dcd-4d63-8c75-ef0d160147fc tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Flavor pref 0:0:0 {{(pid=117722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:06:05.327460 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.virt.hardware [None req-cd6a1954-8dcd-4d63-8c75-ef0d160147fc tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Image pref 0:0:0 {{(pid=117722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:06:05.328231 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.virt.hardware [None req-cd6a1954-8dcd-4d63-8c75-ef0d160147fc tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:06:05.357609 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-cd6a1954-8dcd-4d63-8c75-ef0d160147fc tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:05.358576 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-cd6a1954-8dcd-4d63-8c75-ef0d160147fc tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:05.358906 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-cd6a1954-8dcd-4d63-8c75-ef0d160147fc tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:05.359344 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-cd6a1954-8dcd-4d63-8c75-ef0d160147fc tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:05.384174 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.quota [None req-cd6a1954-8dcd-4d63-8c75-ef0d160147fc tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Getting quotas for project ba5a75cf80284f58b9c3bed674677a39. Resources: {'instances', 'ram', 'cores'} {{(pid=117722) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:06:05.390710 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.quota [None req-cd6a1954-8dcd-4d63-8c75-ef0d160147fc tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Getting quotas for user 9683ec43ae844757883a7dd5003b53d9 and project ba5a75cf80284f58b9c3bed674677a39. Resources: {'instances', 'ram', 'cores'} {{(pid=117722) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:06:05.475276 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-cd6a1954-8dcd-4d63-8c75-ef0d160147fc tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Going to run 1 instances... {{(pid=117722) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:06:05.478150 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-cd6a1954-8dcd-4d63-8c75-ef0d160147fc tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: 8c73af69-886c-4f22-a6d3-001f566d3277] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4d0880ce-2ee1-4d76-944b-b39532fe306e',volume_size=None,volume_type=None)] {{(pid=117722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:06:05.707094 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-cd6a1954-8dcd-4d63-8c75-ef0d160147fc tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.663653 May 26 18:06:05.708002 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 329/621] 10.222.0.69 () {60 vars in 1146 bytes} [Thu May 26 18:06:04 2022] POST /compute/v2.1/servers => generated 405 bytes in 1666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 18:06:05.728357 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-983e4d93-1c3f-43c9-9933-7e66892cff74 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:05.729485 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-983e4d93-1c3f-43c9-9933-7e66892cff74 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: 8c73af69-886c-4f22-a6d3-001f566d3277] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:05.907742 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-983e4d93-1c3f-43c9-9933-7e66892cff74 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683ec43ae844757883a7dd5003b53d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a75cf80284f58b9c3bed674677a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:05.927912 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-983e4d93-1c3f-43c9-9933-7e66892cff74 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "GET /compute/v2.1/servers/8c73af69-886c-4f22-a6d3-001f566d3277" status: 200 len: 1094 microversion: 2.1 time: 0.207175 May 26 18:06:05.929141 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 293/622] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:06:05 2022] GET /compute/v2.1/servers/8c73af69-886c-4f22-a6d3-001f566d3277 => generated 1094 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:05.969796 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-7138712f-460a-4411-85a3-64239f5afd2e tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-800898305", "imageRef": "16351c96-cb02-4711-99d5-fd4d80e8a846", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2cd2844c-2075-4a75-ad58-855aef5bd960"}], "security_groups": [{"name": "tempest-securitygroup--8234723"}], "key_name": "tempest-keypair-1559838106", "user_data": "}} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:06:06.113221 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.network.neutron [None req-7138712f-460a-4411-85a3-64239f5afd2e tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] validate_networks() for [('2cd2844c-2075-4a75-ad58-855aef5bd960', None, None, None, None, None)] {{(pid=117722) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:06:06.322402 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-770a527c-77c7-47b3-be0c-1b3e5f93fcb8 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:06.323037 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-770a527c-77c7-47b3-be0c-1b3e5f93fcb8 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 704b23df-a1e8-425f-a6bf-4805b1356866] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:06.336722 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-770a527c-77c7-47b3-be0c-1b3e5f93fcb8 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:06.339926 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-770a527c-77c7-47b3-be0c-1b3e5f93fcb8 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:06.341051 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-770a527c-77c7-47b3-be0c-1b3e5f93fcb8 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:06.341485 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-770a527c-77c7-47b3-be0c-1b3e5f93fcb8 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:06.619927 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.virt.hardware [None req-7138712f-460a-4411-85a3-64239f5afd2e tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Flavor limits 0:0:0 {{(pid=117722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:06:06.620415 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.virt.hardware [None req-7138712f-460a-4411-85a3-64239f5afd2e tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Image limits 0:0:0 {{(pid=117722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:06:06.621974 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.virt.hardware [None req-7138712f-460a-4411-85a3-64239f5afd2e tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Flavor pref 0:0:0 {{(pid=117722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:06:06.621974 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.virt.hardware [None req-7138712f-460a-4411-85a3-64239f5afd2e tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Image pref 0:0:0 {{(pid=117722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:06:06.621974 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.virt.hardware [None req-7138712f-460a-4411-85a3-64239f5afd2e tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:06:06.640491 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-770a527c-77c7-47b3-be0c-1b3e5f93fcb8 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:06.652218 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7138712f-460a-4411-85a3-64239f5afd2e tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:06.652772 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7138712f-460a-4411-85a3-64239f5afd2e tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:06.653854 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-770a527c-77c7-47b3-be0c-1b3e5f93fcb8 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866" status: 200 len: 1723 microversion: 2.1 time: 0.335899 May 26 18:06:06.654071 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7138712f-460a-4411-85a3-64239f5afd2e tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:06.654931 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7138712f-460a-4411-85a3-64239f5afd2e tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:06.655453 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 294/623] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:06:06 2022] GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866 => generated 1723 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:06:06.684602 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.quota [None req-7138712f-460a-4411-85a3-64239f5afd2e tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Getting quotas for project ab53cc69f7b0424cb689317c4be9b685. Resources: {'instances', 'ram', 'cores'} {{(pid=117722) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:06:06.691325 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.quota [None req-7138712f-460a-4411-85a3-64239f5afd2e tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Getting quotas for user a7cc6fcd7b4c4cee8d21e2692757aaf6 and project ab53cc69f7b0424cb689317c4be9b685. Resources: {'instances', 'ram', 'cores'} {{(pid=117722) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:06:06.711672 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-7138712f-460a-4411-85a3-64239f5afd2e tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Going to run 1 instances... {{(pid=117722) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:06:06.715855 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-7138712f-460a-4411-85a3-64239f5afd2e tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='16351c96-cb02-4711-99d5-fd4d80e8a846',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:06:06.777043 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-7138712f-460a-4411-85a3-64239f5afd2e tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 0.811667 May 26 18:06:06.778162 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 330/624] 10.222.0.69 () {62 vars in 1187 bytes} [Thu May 26 18:06:05 2022] POST /compute/v2.1/servers => generated 399 bytes in 813 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 26 18:06:06.789502 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-50314eaa-c0da-47bf-8484-be4adb640fc1 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:06.790120 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-50314eaa-c0da-47bf-8484-be4adb640fc1 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:06.888642 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-50314eaa-c0da-47bf-8484-be4adb640fc1 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:06.900160 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-50314eaa-c0da-47bf-8484-be4adb640fc1 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:06.903077 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-50314eaa-c0da-47bf-8484-be4adb640fc1 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:06.904953 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-50314eaa-c0da-47bf-8484-be4adb640fc1 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1281 microversion: 2.20 time: 0.120526 May 26 18:06:06.912664 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 295/625] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:06:06 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1281 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:06:06.950400 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-be13eb96-0c30-4cc0-a089-8707b231e63c tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:06.951123 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-be13eb96-0c30-4cc0-a089-8707b231e63c tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: 8c73af69-886c-4f22-a6d3-001f566d3277] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:06.983477 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-be13eb96-0c30-4cc0-a089-8707b231e63c tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:06.984932 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-be13eb96-0c30-4cc0-a089-8707b231e63c tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:06.986140 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-be13eb96-0c30-4cc0-a089-8707b231e63c tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:06.986802 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-be13eb96-0c30-4cc0-a089-8707b231e63c tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:07.089760 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-be13eb96-0c30-4cc0-a089-8707b231e63c tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683ec43ae844757883a7dd5003b53d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a75cf80284f58b9c3bed674677a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:07.106133 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-be13eb96-0c30-4cc0-a089-8707b231e63c tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "GET /compute/v2.1/servers/8c73af69-886c-4f22-a6d3-001f566d3277" status: 200 len: 1136 microversion: 2.1 time: 0.163220 May 26 18:06:07.107796 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 331/626] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:06:06 2022] GET /compute/v2.1/servers/8c73af69-886c-4f22-a6d3-001f566d3277 => generated 1136 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:06:07.314322 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-560e7d60-d751-4b25-a869-edf9ad54ab55 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1771084794", "imageRef": "16351c96-cb02-4711-99d5-fd4d80e8a846", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "481c535b-a9e7-4c84-8151-52762a8d6376"}], "security_groups": [{"name": "tempest-securitygroup--1237900495"}], "key_name": "tempest-keypair-525900821", "user_data": "}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:06:07.474305 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.network.neutron [None req-560e7d60-d751-4b25-a869-edf9ad54ab55 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] validate_networks() for [('481c535b-a9e7-4c84-8151-52762a8d6376', None, None, None, None, None)] {{(pid=117723) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:06:07.687119 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-30afb915-8afa-4976-8178-c0e918a6c1d1 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:07.690086 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-30afb915-8afa-4976-8178-c0e918a6c1d1 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 704b23df-a1e8-425f-a6bf-4805b1356866] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:07.697259 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-30afb915-8afa-4976-8178-c0e918a6c1d1 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:07.697970 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-30afb915-8afa-4976-8178-c0e918a6c1d1 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:07.699270 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-30afb915-8afa-4976-8178-c0e918a6c1d1 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:07.700192 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-30afb915-8afa-4976-8178-c0e918a6c1d1 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:07.871442 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-30afb915-8afa-4976-8178-c0e918a6c1d1 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:07.880361 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-30afb915-8afa-4976-8178-c0e918a6c1d1 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866" status: 200 len: 1729 microversion: 2.1 time: 0.209320 May 26 18:06:07.881109 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 332/627] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:06:07 2022] GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866 => generated 1729 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:07.898536 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-2b4832d3-af97-41cc-8efb-f31cb28955dc tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:07.899032 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-2b4832d3-af97-41cc-8efb-f31cb28955dc tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 704b23df-a1e8-425f-a6bf-4805b1356866] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:07.905863 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-2b4832d3-af97-41cc-8efb-f31cb28955dc tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:07.906393 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-2b4832d3-af97-41cc-8efb-f31cb28955dc tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:07.907393 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-2b4832d3-af97-41cc-8efb-f31cb28955dc tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:07.907828 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-2b4832d3-af97-41cc-8efb-f31cb28955dc tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:08.001237 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-2b4832d3-af97-41cc-8efb-f31cb28955dc tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.107540 May 26 18:06:08.001857 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 333/628] 10.222.0.69 () {58 vars in 1274 bytes} [Thu May 26 18:06:07 2022] GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866/os-interface => generated 285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:06:08.007819 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-8a47de81-20c6-4630-9c4d-9ed161cedf20 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:08.008901 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-8a47de81-20c6-4630-9c4d-9ed161cedf20 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:08.021198 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-8a47de81-20c6-4630-9c4d-9ed161cedf20 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:08.021390 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-8a47de81-20c6-4630-9c4d-9ed161cedf20 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:08.022536 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-8a47de81-20c6-4630-9c4d-9ed161cedf20 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:08.023142 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-8a47de81-20c6-4630-9c4d-9ed161cedf20 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:08.124717 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-8a47de81-20c6-4630-9c4d-9ed161cedf20 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:08.139080 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-8a47de81-20c6-4630-9c4d-9ed161cedf20 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:08.142669 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-8a47de81-20c6-4630-9c4d-9ed161cedf20 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:08.148272 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-8a47de81-20c6-4630-9c4d-9ed161cedf20 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1333 microversion: 2.20 time: 0.142089 May 26 18:06:08.151515 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 334/629] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:06:08 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1333 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:06:08.166754 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-90d68358-d578-488c-914a-9d546d32a428 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:08.167956 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-90d68358-d578-488c-914a-9d546d32a428 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: 8c73af69-886c-4f22-a6d3-001f566d3277] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:08.179044 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-90d68358-d578-488c-914a-9d546d32a428 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:08.179593 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-90d68358-d578-488c-914a-9d546d32a428 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:08.181085 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-90d68358-d578-488c-914a-9d546d32a428 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:08.181866 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-90d68358-d578-488c-914a-9d546d32a428 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:08.274960 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-90d68358-d578-488c-914a-9d546d32a428 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683ec43ae844757883a7dd5003b53d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a75cf80284f58b9c3bed674677a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:08.286567 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-90d68358-d578-488c-914a-9d546d32a428 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "GET /compute/v2.1/servers/8c73af69-886c-4f22-a6d3-001f566d3277" status: 200 len: 1210 microversion: 2.1 time: 0.132679 May 26 18:06:08.287676 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 335/630] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:06:08 2022] GET /compute/v2.1/servers/8c73af69-886c-4f22-a6d3-001f566d3277 => generated 1210 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:08.441093 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-560e7d60-d751-4b25-a869-edf9ad54ab55 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Flavor limits 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:06:08.442152 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-560e7d60-d751-4b25-a869-edf9ad54ab55 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Image limits 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:06:08.443836 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-560e7d60-d751-4b25-a869-edf9ad54ab55 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Flavor pref 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:06:08.444657 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-560e7d60-d751-4b25-a869-edf9ad54ab55 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Image pref 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:06:08.445231 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-560e7d60-d751-4b25-a869-edf9ad54ab55 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:06:08.457000 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-560e7d60-d751-4b25-a869-edf9ad54ab55 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:08.457746 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-560e7d60-d751-4b25-a869-edf9ad54ab55 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:08.458823 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-560e7d60-d751-4b25-a869-edf9ad54ab55 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:08.459446 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-560e7d60-d751-4b25-a869-edf9ad54ab55 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:08.492786 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-560e7d60-d751-4b25-a869-edf9ad54ab55 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Getting quotas for project 8920d2de9dc34386bb0e770f5b51b702. Resources: {'instances', 'ram', 'cores'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:06:08.504748 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-560e7d60-d751-4b25-a869-edf9ad54ab55 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Getting quotas for user 2691e1dc96e942b5ba4c726b72a835e9 and project 8920d2de9dc34386bb0e770f5b51b702. Resources: {'instances', 'ram', 'cores'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:06:08.518657 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-560e7d60-d751-4b25-a869-edf9ad54ab55 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Going to run 1 instances... {{(pid=117723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:06:08.521363 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-560e7d60-d751-4b25-a869-edf9ad54ab55 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 8a2d2dde-ab10-41d4-ab33-ad703f697b84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='16351c96-cb02-4711-99d5-fd4d80e8a846',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:06:08.591923 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-560e7d60-d751-4b25-a869-edf9ad54ab55 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.282990 May 26 18:06:08.593420 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 296/631] 10.222.0.69 () {60 vars in 1146 bytes} [Thu May 26 18:06:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 1286 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 18:06:08.608327 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-ad935bb6-b052-4a17-ba1f-8e7426e34ba3 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:08.613826 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-ad935bb6-b052-4a17-ba1f-8e7426e34ba3 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 8a2d2dde-ab10-41d4-ab33-ad703f697b84] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:08.733322 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-ad935bb6-b052-4a17-ba1f-8e7426e34ba3 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:08.743747 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-ad935bb6-b052-4a17-ba1f-8e7426e34ba3 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/8a2d2dde-ab10-41d4-ab33-ad703f697b84" status: 200 len: 1241 microversion: 2.1 time: 0.142804 May 26 18:06:08.757199 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 336/632] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:06:08 2022] GET /compute/v2.1/servers/8a2d2dde-ab10-41d4-ab33-ad703f697b84 => generated 1241 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:09.177866 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-cb63a5b3-9b94-4fbf-b7dc-36cb3da423dc tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:09.179277 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-cb63a5b3-9b94-4fbf-b7dc-36cb3da423dc tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:09.203605 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-cb63a5b3-9b94-4fbf-b7dc-36cb3da423dc tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:09.207384 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-cb63a5b3-9b94-4fbf-b7dc-36cb3da423dc tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:09.210838 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-cb63a5b3-9b94-4fbf-b7dc-36cb3da423dc tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:09.214377 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-cb63a5b3-9b94-4fbf-b7dc-36cb3da423dc tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:09.307466 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-52035b3d-c86d-4507-8ba0-efadb7baef05 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:09.308454 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-52035b3d-c86d-4507-8ba0-efadb7baef05 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: 8c73af69-886c-4f22-a6d3-001f566d3277] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:09.327675 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-52035b3d-c86d-4507-8ba0-efadb7baef05 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:09.327913 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-cb63a5b3-9b94-4fbf-b7dc-36cb3da423dc tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:09.328617 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-52035b3d-c86d-4507-8ba0-efadb7baef05 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:09.329573 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-52035b3d-c86d-4507-8ba0-efadb7baef05 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:09.330181 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-52035b3d-c86d-4507-8ba0-efadb7baef05 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:09.343635 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-cb63a5b3-9b94-4fbf-b7dc-36cb3da423dc tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:09.347047 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-cb63a5b3-9b94-4fbf-b7dc-36cb3da423dc tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:09.349991 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-cb63a5b3-9b94-4fbf-b7dc-36cb3da423dc tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1339 microversion: 2.20 time: 0.185602 May 26 18:06:09.352069 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 297/633] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:06:09 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1339 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:06:09.357718 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-842c8aed-03ad-4744-804b-1c7350f8c393 req-61ff828c-8352-4f98-a55b-85272269cdb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "704b23df-a1e8-425f-a6bf-4805b1356866", "tag": "b3168a60-01f6-45c3-989d-b7db5593ac6f"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:06:09.372574 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-842c8aed-03ad-4744-804b-1c7350f8c393 req-61ff828c-8352-4f98-a55b-85272269cdb0 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:09.373497 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-842c8aed-03ad-4744-804b-1c7350f8c393 req-61ff828c-8352-4f98-a55b-85272269cdb0 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:09.402324 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-842c8aed-03ad-4744-804b-1c7350f8c393 req-61ff828c-8352-4f98-a55b-85272269cdb0 service nova] Creating event network-changed:b3168a60-01f6-45c3-989d-b7db5593ac6f for instance 704b23df-a1e8-425f-a6bf-4805b1356866 on hv-cinder-83607 May 26 18:06:09.413416 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-842c8aed-03ad-4744-804b-1c7350f8c393 req-61ff828c-8352-4f98-a55b-85272269cdb0 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057631 May 26 18:06:09.414821 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 298/634] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:06:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:06:09.475689 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-52035b3d-c86d-4507-8ba0-efadb7baef05 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683ec43ae844757883a7dd5003b53d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a75cf80284f58b9c3bed674677a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:09.484982 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-52035b3d-c86d-4507-8ba0-efadb7baef05 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "GET /compute/v2.1/servers/8c73af69-886c-4f22-a6d3-001f566d3277" status: 200 len: 1198 microversion: 2.1 time: 0.181738 May 26 18:06:09.485919 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 337/635] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:06:09 2022] GET /compute/v2.1/servers/8c73af69-886c-4f22-a6d3-001f566d3277 => generated 1198 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:09.763580 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-2caf7bd9-4da6-4f32-9824-8eef05f19dab tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:09.764927 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-2caf7bd9-4da6-4f32-9824-8eef05f19dab tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 8a2d2dde-ab10-41d4-ab33-ad703f697b84] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:09.775743 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2caf7bd9-4da6-4f32-9824-8eef05f19dab tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:09.780349 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2caf7bd9-4da6-4f32-9824-8eef05f19dab tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:09.781492 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2caf7bd9-4da6-4f32-9824-8eef05f19dab tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:09.789331 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2caf7bd9-4da6-4f32-9824-8eef05f19dab tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:09.983513 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-2caf7bd9-4da6-4f32-9824-8eef05f19dab tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:10.002839 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-2caf7bd9-4da6-4f32-9824-8eef05f19dab tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/8a2d2dde-ab10-41d4-ab33-ad703f697b84" status: 200 len: 1293 microversion: 2.1 time: 0.244052 May 26 18:06:10.013241 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 299/636] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:06:09 2022] GET /compute/v2.1/servers/8a2d2dde-ab10-41d4-ab33-ad703f697b84 => generated 1293 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:06:10.372132 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-77459a90-3125-4590-aa46-8ba313d6a9cc tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:10.373427 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-77459a90-3125-4590-aa46-8ba313d6a9cc tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:10.381514 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-77459a90-3125-4590-aa46-8ba313d6a9cc tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:10.382276 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-77459a90-3125-4590-aa46-8ba313d6a9cc tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:10.383335 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-77459a90-3125-4590-aa46-8ba313d6a9cc tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:10.384621 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-77459a90-3125-4590-aa46-8ba313d6a9cc tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:10.521599 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-9475a631-dc8b-4755-9aae-47ef7c8e55e2 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:10.522833 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-9475a631-dc8b-4755-9aae-47ef7c8e55e2 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: 8c73af69-886c-4f22-a6d3-001f566d3277] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:10.535733 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9475a631-dc8b-4755-9aae-47ef7c8e55e2 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:10.537190 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9475a631-dc8b-4755-9aae-47ef7c8e55e2 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:10.539215 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9475a631-dc8b-4755-9aae-47ef7c8e55e2 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:10.540645 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9475a631-dc8b-4755-9aae-47ef7c8e55e2 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:10.671428 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-77459a90-3125-4590-aa46-8ba313d6a9cc tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:10.682885 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-77459a90-3125-4590-aa46-8ba313d6a9cc tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:10.684993 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-77459a90-3125-4590-aa46-8ba313d6a9cc tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:10.686398 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-77459a90-3125-4590-aa46-8ba313d6a9cc tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1404 microversion: 2.20 time: 0.319020 May 26 18:06:10.698416 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 338/637] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:06:10 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1404 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:06:11.022817 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-650424ba-dc77-471a-b667-e1ecb17fcef4 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:11.024145 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-650424ba-dc77-471a-b667-e1ecb17fcef4 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 8a2d2dde-ab10-41d4-ab33-ad703f697b84] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:11.032861 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-650424ba-dc77-471a-b667-e1ecb17fcef4 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:11.033510 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-650424ba-dc77-471a-b667-e1ecb17fcef4 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:11.034543 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-650424ba-dc77-471a-b667-e1ecb17fcef4 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:11.035267 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-650424ba-dc77-471a-b667-e1ecb17fcef4 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:11.173010 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-650424ba-dc77-471a-b667-e1ecb17fcef4 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:11.186444 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-650424ba-dc77-471a-b667-e1ecb17fcef4 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/8a2d2dde-ab10-41d4-ab33-ad703f697b84" status: 200 len: 1299 microversion: 2.1 time: 0.167809 May 26 18:06:11.200946 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 339/638] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:06:11 2022] GET /compute/v2.1/servers/8a2d2dde-ab10-41d4-ab33-ad703f697b84 => generated 1299 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:11.343494 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-9475a631-dc8b-4755-9aae-47ef7c8e55e2 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683ec43ae844757883a7dd5003b53d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a75cf80284f58b9c3bed674677a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:11.373031 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-9475a631-dc8b-4755-9aae-47ef7c8e55e2 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "GET /compute/v2.1/servers/8c73af69-886c-4f22-a6d3-001f566d3277" status: 200 len: 1265 microversion: 2.1 time: 0.863822 May 26 18:06:11.373913 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 300/639] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:06:10 2022] GET /compute/v2.1/servers/8c73af69-886c-4f22-a6d3-001f566d3277 => generated 1265 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:11.443887 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [req-ef252b00-878e-449d-81db-b3ef2c8e66fd req-945b1ed1-e9e4-4990-a968-da12afb9ecf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "704b23df-a1e8-425f-a6bf-4805b1356866", "tag": "b3168a60-01f6-45c3-989d-b7db5593ac6f"}]} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:06:11.464193 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-ef252b00-878e-449d-81db-b3ef2c8e66fd req-945b1ed1-e9e4-4990-a968-da12afb9ecf4 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:11.465318 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-ef252b00-878e-449d-81db-b3ef2c8e66fd req-945b1ed1-e9e4-4990-a968-da12afb9ecf4 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:11.495425 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.compute.server_external_events [req-ef252b00-878e-449d-81db-b3ef2c8e66fd req-945b1ed1-e9e4-4990-a968-da12afb9ecf4 service nova] Creating event network-changed:b3168a60-01f6-45c3-989d-b7db5593ac6f for instance 704b23df-a1e8-425f-a6bf-4805b1356866 on hv-cinder-83607 May 26 18:06:11.507496 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [req-ef252b00-878e-449d-81db-b3ef2c8e66fd req-945b1ed1-e9e4-4990-a968-da12afb9ecf4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069096 May 26 18:06:11.508743 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 340/640] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:06:11.707152 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-aa85add1-db45-4148-823c-916b05ce227f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:11.709071 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-aa85add1-db45-4148-823c-916b05ce227f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:11.726761 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-aa85add1-db45-4148-823c-916b05ce227f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:11.727416 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-aa85add1-db45-4148-823c-916b05ce227f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:11.729408 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-aa85add1-db45-4148-823c-916b05ce227f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:11.734253 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-aa85add1-db45-4148-823c-916b05ce227f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:12.210547 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-e40305b8-5e45-43d8-8daa-52f91414fa83 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:12.211269 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-e40305b8-5e45-43d8-8daa-52f91414fa83 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 8a2d2dde-ab10-41d4-ab33-ad703f697b84] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:12.228133 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e40305b8-5e45-43d8-8daa-52f91414fa83 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:12.228598 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e40305b8-5e45-43d8-8daa-52f91414fa83 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:12.229396 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e40305b8-5e45-43d8-8daa-52f91414fa83 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:12.229818 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e40305b8-5e45-43d8-8daa-52f91414fa83 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:12.330627 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-aa85add1-db45-4148-823c-916b05ce227f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:12.342935 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-aa85add1-db45-4148-823c-916b05ce227f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:12.345576 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-aa85add1-db45-4148-823c-916b05ce227f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:12.349283 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-aa85add1-db45-4148-823c-916b05ce227f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1404 microversion: 2.20 time: 0.645661 May 26 18:06:12.352438 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 301/641] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:06:11 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1404 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:06:12.365147 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-06bbcd9a-c9ff-47a7-988c-69928c3cf5f3 req-7e001131-a63e-4951-9115-de7bf175dde8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c73af69-886c-4f22-a6d3-001f566d3277", "tag": "0be12dc6-5e46-49db-9a74-e8a86e2b117d"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:06:12.419947 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-06bbcd9a-c9ff-47a7-988c-69928c3cf5f3 req-7e001131-a63e-4951-9115-de7bf175dde8 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:12.420861 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-06bbcd9a-c9ff-47a7-988c-69928c3cf5f3 req-7e001131-a63e-4951-9115-de7bf175dde8 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:12.450828 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-06bbcd9a-c9ff-47a7-988c-69928c3cf5f3 req-7e001131-a63e-4951-9115-de7bf175dde8 service nova] Creating event network-changed:0be12dc6-5e46-49db-9a74-e8a86e2b117d for instance 8c73af69-886c-4f22-a6d3-001f566d3277 on hv-cinder-83607 May 26 18:06:12.462593 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-06bbcd9a-c9ff-47a7-988c-69928c3cf5f3 req-7e001131-a63e-4951-9115-de7bf175dde8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108391 May 26 18:06:12.463724 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 302/642] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:06:12.471009 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-31020ea3-931f-48b5-bd45-f6d29fc3f3e2 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:12.472110 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-31020ea3-931f-48b5-bd45-f6d29fc3f3e2 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: 8c73af69-886c-4f22-a6d3-001f566d3277] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:12.482044 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-31020ea3-931f-48b5-bd45-f6d29fc3f3e2 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:12.482831 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-31020ea3-931f-48b5-bd45-f6d29fc3f3e2 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:12.485097 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-31020ea3-931f-48b5-bd45-f6d29fc3f3e2 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:12.485586 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-31020ea3-931f-48b5-bd45-f6d29fc3f3e2 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:12.561805 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-e40305b8-5e45-43d8-8daa-52f91414fa83 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:12.589732 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-e40305b8-5e45-43d8-8daa-52f91414fa83 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/8a2d2dde-ab10-41d4-ab33-ad703f697b84" status: 200 len: 1367 microversion: 2.1 time: 0.383437 May 26 18:06:12.592231 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 341/643] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:06:12 2022] GET /compute/v2.1/servers/8a2d2dde-ab10-41d4-ab33-ad703f697b84 => generated 1367 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:13.043779 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-31020ea3-931f-48b5-bd45-f6d29fc3f3e2 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683ec43ae844757883a7dd5003b53d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a75cf80284f58b9c3bed674677a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:13.055247 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-31020ea3-931f-48b5-bd45-f6d29fc3f3e2 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "GET /compute/v2.1/servers/8c73af69-886c-4f22-a6d3-001f566d3277" status: 200 len: 1265 microversion: 2.1 time: 0.589530 May 26 18:06:13.056427 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 303/644] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:06:12 2022] GET /compute/v2.1/servers/8c73af69-886c-4f22-a6d3-001f566d3277 => generated 1265 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:13.382333 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-d47667b7-5bdf-4f56-9d65-43c9c18f2a43 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:13.383639 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-d47667b7-5bdf-4f56-9d65-43c9c18f2a43 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:13.394976 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d47667b7-5bdf-4f56-9d65-43c9c18f2a43 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:13.396857 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d47667b7-5bdf-4f56-9d65-43c9c18f2a43 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:13.398234 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d47667b7-5bdf-4f56-9d65-43c9c18f2a43 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:13.398995 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d47667b7-5bdf-4f56-9d65-43c9c18f2a43 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:13.542100 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-709e1e1d-88c9-4b18-b979-8779b82c6461 req-6eda7dc9-6bc8-4427-8603-30750177e73c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a2d2dde-ab10-41d4-ab33-ad703f697b84", "tag": "def34736-9172-4fd2-aaf3-a11444afd3f9"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:06:13.561369 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-709e1e1d-88c9-4b18-b979-8779b82c6461 req-6eda7dc9-6bc8-4427-8603-30750177e73c service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:13.562117 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-709e1e1d-88c9-4b18-b979-8779b82c6461 req-6eda7dc9-6bc8-4427-8603-30750177e73c service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:13.582118 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-709e1e1d-88c9-4b18-b979-8779b82c6461 req-6eda7dc9-6bc8-4427-8603-30750177e73c service nova] Creating event network-changed:def34736-9172-4fd2-aaf3-a11444afd3f9 for instance 8a2d2dde-ab10-41d4-ab33-ad703f697b84 on hv-cinder-83607 May 26 18:06:13.591271 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-709e1e1d-88c9-4b18-b979-8779b82c6461 req-6eda7dc9-6bc8-4427-8603-30750177e73c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055945 May 26 18:06:13.592618 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 304/645] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:06:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:06:13.611985 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-66f9c629-a7ab-4f29-8411-de924bc63056 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:13.613395 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-66f9c629-a7ab-4f29-8411-de924bc63056 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 8a2d2dde-ab10-41d4-ab33-ad703f697b84] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:13.623146 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-d47667b7-5bdf-4f56-9d65-43c9c18f2a43 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:13.624800 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-66f9c629-a7ab-4f29-8411-de924bc63056 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:13.625652 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-66f9c629-a7ab-4f29-8411-de924bc63056 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:13.627062 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-66f9c629-a7ab-4f29-8411-de924bc63056 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:13.628009 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-66f9c629-a7ab-4f29-8411-de924bc63056 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:13.634730 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-d47667b7-5bdf-4f56-9d65-43c9c18f2a43 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:13.637510 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-d47667b7-5bdf-4f56-9d65-43c9c18f2a43 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:13.639639 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-d47667b7-5bdf-4f56-9d65-43c9c18f2a43 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1404 microversion: 2.20 time: 0.265101 May 26 18:06:13.640915 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 342/646] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:06:13 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1404 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:06:13.916974 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-66f9c629-a7ab-4f29-8411-de924bc63056 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:13.924974 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-66f9c629-a7ab-4f29-8411-de924bc63056 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/8a2d2dde-ab10-41d4-ab33-ad703f697b84" status: 200 len: 1367 microversion: 2.1 time: 0.319386 May 26 18:06:13.925564 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 305/647] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:06:13 2022] GET /compute/v2.1/servers/8a2d2dde-ab10-41d4-ab33-ad703f697b84 => generated 1367 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:14.073651 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-632d82d4-af60-4ee0-8728-00e76ca98ca2 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:14.074299 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-632d82d4-af60-4ee0-8728-00e76ca98ca2 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: 8c73af69-886c-4f22-a6d3-001f566d3277] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:14.080893 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-632d82d4-af60-4ee0-8728-00e76ca98ca2 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:14.081342 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-632d82d4-af60-4ee0-8728-00e76ca98ca2 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:14.082136 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-632d82d4-af60-4ee0-8728-00e76ca98ca2 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:14.082578 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-632d82d4-af60-4ee0-8728-00e76ca98ca2 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:14.246086 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-632d82d4-af60-4ee0-8728-00e76ca98ca2 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683ec43ae844757883a7dd5003b53d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a75cf80284f58b9c3bed674677a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:14.248889 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:14.258526 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-632d82d4-af60-4ee0-8728-00e76ca98ca2 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "GET /compute/v2.1/servers/8c73af69-886c-4f22-a6d3-001f566d3277" status: 200 len: 1265 microversion: 2.1 time: 0.188868 May 26 18:06:14.259402 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 343/648] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:06:14 2022] GET /compute/v2.1/servers/8c73af69-886c-4f22-a6d3-001f566d3277 => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:06:14.513687 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-a927b954-a8d3-466e-81e3-c53540a304a9 req-88f7ff77-0a16-4449-b57b-ca962023c340 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09d62436-ae28-4b39-90d2-4530f04e4f66", "tag": "4f4d056e-de52-4943-ab5b-725a0214cc05"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:06:14.524387 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-a927b954-a8d3-466e-81e3-c53540a304a9 req-88f7ff77-0a16-4449-b57b-ca962023c340 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:14.524853 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-a927b954-a8d3-466e-81e3-c53540a304a9 req-88f7ff77-0a16-4449-b57b-ca962023c340 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:14.545597 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-a927b954-a8d3-466e-81e3-c53540a304a9 req-88f7ff77-0a16-4449-b57b-ca962023c340 service nova] Creating event network-changed:4f4d056e-de52-4943-ab5b-725a0214cc05 for instance 09d62436-ae28-4b39-90d2-4530f04e4f66 on hv-cinder-83607 May 26 18:06:14.553228 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-a927b954-a8d3-466e-81e3-c53540a304a9 req-88f7ff77-0a16-4449-b57b-ca962023c340 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043153 May 26 18:06:14.553872 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 306/649] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:06:14.660156 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-47169b37-4ebf-4a2c-8ecf-5c3f52c07025 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:14.660885 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-47169b37-4ebf-4a2c-8ecf-5c3f52c07025 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:14.670186 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-47169b37-4ebf-4a2c-8ecf-5c3f52c07025 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:14.670646 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-47169b37-4ebf-4a2c-8ecf-5c3f52c07025 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:14.671554 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-47169b37-4ebf-4a2c-8ecf-5c3f52c07025 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:14.672195 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-47169b37-4ebf-4a2c-8ecf-5c3f52c07025 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:14.846883 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-47169b37-4ebf-4a2c-8ecf-5c3f52c07025 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:14.857596 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-47169b37-4ebf-4a2c-8ecf-5c3f52c07025 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:14.859155 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-47169b37-4ebf-4a2c-8ecf-5c3f52c07025 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:14.860371 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-47169b37-4ebf-4a2c-8ecf-5c3f52c07025 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1404 microversion: 2.20 time: 0.204865 May 26 18:06:14.860959 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 344/650] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:06:14 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1404 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:06:14.943822 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-3c8c7fe6-6ecf-4a29-926c-7c0cd0ba9f8c tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:14.944567 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-3c8c7fe6-6ecf-4a29-926c-7c0cd0ba9f8c tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 8a2d2dde-ab10-41d4-ab33-ad703f697b84] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:14.951435 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3c8c7fe6-6ecf-4a29-926c-7c0cd0ba9f8c tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:14.951892 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3c8c7fe6-6ecf-4a29-926c-7c0cd0ba9f8c tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:14.952719 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3c8c7fe6-6ecf-4a29-926c-7c0cd0ba9f8c tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:14.953196 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3c8c7fe6-6ecf-4a29-926c-7c0cd0ba9f8c tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:15.229655 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-3c8c7fe6-6ecf-4a29-926c-7c0cd0ba9f8c tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:15.238517 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-3c8c7fe6-6ecf-4a29-926c-7c0cd0ba9f8c tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/8a2d2dde-ab10-41d4-ab33-ad703f697b84" status: 200 len: 1367 microversion: 2.1 time: 0.299710 May 26 18:06:15.239803 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 307/651] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:06:14 2022] GET /compute/v2.1/servers/8a2d2dde-ab10-41d4-ab33-ad703f697b84 => generated 1367 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:15.281351 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-d8f0c3b6-86a8-4de7-a39f-955e3bd491bd tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:15.282556 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-d8f0c3b6-86a8-4de7-a39f-955e3bd491bd tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: 8c73af69-886c-4f22-a6d3-001f566d3277] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:15.284885 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:15.292859 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d8f0c3b6-86a8-4de7-a39f-955e3bd491bd tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:15.293306 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d8f0c3b6-86a8-4de7-a39f-955e3bd491bd tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:15.294120 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d8f0c3b6-86a8-4de7-a39f-955e3bd491bd tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:15.294564 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d8f0c3b6-86a8-4de7-a39f-955e3bd491bd tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:15.570226 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-d8f0c3b6-86a8-4de7-a39f-955e3bd491bd tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683ec43ae844757883a7dd5003b53d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a75cf80284f58b9c3bed674677a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:15.578475 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-d8f0c3b6-86a8-4de7-a39f-955e3bd491bd tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "GET /compute/v2.1/servers/8c73af69-886c-4f22-a6d3-001f566d3277" status: 200 len: 1265 microversion: 2.1 time: 0.304849 May 26 18:06:15.579077 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 345/652] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:06:15 2022] GET /compute/v2.1/servers/8c73af69-886c-4f22-a6d3-001f566d3277 => generated 1265 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:06:15.879289 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-8a9654c9-c658-4edd-bc9d-c348494dca21 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:15.881064 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-8a9654c9-c658-4edd-bc9d-c348494dca21 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:15.887479 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8a9654c9-c658-4edd-bc9d-c348494dca21 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:15.887927 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8a9654c9-c658-4edd-bc9d-c348494dca21 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:15.888744 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8a9654c9-c658-4edd-bc9d-c348494dca21 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:15.889183 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8a9654c9-c658-4edd-bc9d-c348494dca21 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:16.031537 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-8a9654c9-c658-4edd-bc9d-c348494dca21 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:16.035156 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=100 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:16.042280 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-8a9654c9-c658-4edd-bc9d-c348494dca21 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:16.043801 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-8a9654c9-c658-4edd-bc9d-c348494dca21 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:16.044968 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-8a9654c9-c658-4edd-bc9d-c348494dca21 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1404 microversion: 2.20 time: 0.169933 May 26 18:06:16.045532 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 308/653] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:06:15 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1404 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:06:16.258166 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-a1370c97-fa1b-48b2-a6b7-3cd470c7fbfc tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:16.258787 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-a1370c97-fa1b-48b2-a6b7-3cd470c7fbfc tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 8a2d2dde-ab10-41d4-ab33-ad703f697b84] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:16.267150 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-a1370c97-fa1b-48b2-a6b7-3cd470c7fbfc tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:16.267668 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-a1370c97-fa1b-48b2-a6b7-3cd470c7fbfc tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:16.268649 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-a1370c97-fa1b-48b2-a6b7-3cd470c7fbfc tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:16.269150 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-a1370c97-fa1b-48b2-a6b7-3cd470c7fbfc tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:16.431514 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-a1370c97-fa1b-48b2-a6b7-3cd470c7fbfc tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:16.441188 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-a1370c97-fa1b-48b2-a6b7-3cd470c7fbfc tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/8a2d2dde-ab10-41d4-ab33-ad703f697b84" status: 200 len: 1367 microversion: 2.1 time: 0.187773 May 26 18:06:16.442364 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 346/654] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:06:16 2022] GET /compute/v2.1/servers/8a2d2dde-ab10-41d4-ab33-ad703f697b84 => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:16.528391 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-0b8a70f2-b6a0-4bf9-abb8-e966a80a8e88 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:16.529324 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-0b8a70f2-b6a0-4bf9-abb8-e966a80a8e88 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:16.535569 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0b8a70f2-b6a0-4bf9-abb8-e966a80a8e88 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:16.537008 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0b8a70f2-b6a0-4bf9-abb8-e966a80a8e88 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:16.537791 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0b8a70f2-b6a0-4bf9-abb8-e966a80a8e88 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:16.538227 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0b8a70f2-b6a0-4bf9-abb8-e966a80a8e88 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:16.574224 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-0b8a70f2-b6a0-4bf9-abb8-e966a80a8e88 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049721 May 26 18:06:16.574815 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 309/655] 10.222.0.69 () {58 vars in 1301 bytes} [Thu May 26 18:06:16 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 18:06:16.596748 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-0dcaba43-f1e9-41d0-8192-2603060f6706 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:16.597364 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-0dcaba43-f1e9-41d0-8192-2603060f6706 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: 8c73af69-886c-4f22-a6d3-001f566d3277] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:16.604419 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0dcaba43-f1e9-41d0-8192-2603060f6706 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:16.605069 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0dcaba43-f1e9-41d0-8192-2603060f6706 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:16.606201 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0dcaba43-f1e9-41d0-8192-2603060f6706 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:16.606852 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0dcaba43-f1e9-41d0-8192-2603060f6706 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:16.647151 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-0705e60f-6a46-45f7-a922-b776bf6dcc3c tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:16.647654 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-0705e60f-6a46-45f7-a922-b776bf6dcc3c tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:16.654213 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0705e60f-6a46-45f7-a922-b776bf6dcc3c tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:16.654673 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0705e60f-6a46-45f7-a922-b776bf6dcc3c tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:16.655471 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0705e60f-6a46-45f7-a922-b776bf6dcc3c tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:16.656115 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0705e60f-6a46-45f7-a922-b776bf6dcc3c tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:16.667646 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_cell0:SELECT=4 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:16.687043 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-0705e60f-6a46-45f7-a922-b776bf6dcc3c tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Going to try to terminate instance {{(pid=117723) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:06:16.776128 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-0705e60f-6a46-45f7-a922-b776bf6dcc3c tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "DELETE /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 204 len: 0 microversion: 2.1 time: 0.133119 May 26 18:06:16.776695 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 310/656] 10.222.0.69 () {58 vars in 1238 bytes} [Thu May 26 18:06:16 2022] DELETE /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 26 18:06:16.789562 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-e2ac9706-7455-44bd-90c4-dbd1502bab38 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:16.790277 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-e2ac9706-7455-44bd-90c4-dbd1502bab38 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:16.797272 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e2ac9706-7455-44bd-90c4-dbd1502bab38 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:16.797727 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e2ac9706-7455-44bd-90c4-dbd1502bab38 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:16.798523 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e2ac9706-7455-44bd-90c4-dbd1502bab38 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:16.798977 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e2ac9706-7455-44bd-90c4-dbd1502bab38 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:16.807134 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-0dcaba43-f1e9-41d0-8192-2603060f6706 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683ec43ae844757883a7dd5003b53d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a75cf80284f58b9c3bed674677a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:16.822796 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-0dcaba43-f1e9-41d0-8192-2603060f6706 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "GET /compute/v2.1/servers/8c73af69-886c-4f22-a6d3-001f566d3277" status: 200 len: 1265 microversion: 2.1 time: 0.228852 May 26 18:06:16.824791 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 347/657] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:06:16 2022] GET /compute/v2.1/servers/8c73af69-886c-4f22-a6d3-001f566d3277 => generated 1265 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:17.047858 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-e2ac9706-7455-44bd-90c4-dbd1502bab38 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:17.064248 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-e2ac9706-7455-44bd-90c4-dbd1502bab38 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1671 microversion: 2.1 time: 0.278386 May 26 18:06:17.065457 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 311/658] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:06:16 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1671 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:17.073688 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-2867382b-9066-4522-ae82-fb4f99821d3a tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:17.075533 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-2867382b-9066-4522-ae82-fb4f99821d3a tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:17.084395 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-2867382b-9066-4522-ae82-fb4f99821d3a tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:17.085198 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-2867382b-9066-4522-ae82-fb4f99821d3a tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:17.086015 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-2867382b-9066-4522-ae82-fb4f99821d3a tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:17.086633 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-2867382b-9066-4522-ae82-fb4f99821d3a tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:17.278275 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-2867382b-9066-4522-ae82-fb4f99821d3a tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:17.287553 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-2867382b-9066-4522-ae82-fb4f99821d3a tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:17.289106 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-2867382b-9066-4522-ae82-fb4f99821d3a tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:17.290244 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-2867382b-9066-4522-ae82-fb4f99821d3a tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1404 microversion: 2.20 time: 0.226624 May 26 18:06:17.290812 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 348/659] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:06:17 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1404 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:06:17.459604 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-fe198ccc-fc85-4336-9730-f381f86d9af0 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:17.460471 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-fe198ccc-fc85-4336-9730-f381f86d9af0 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 8a2d2dde-ab10-41d4-ab33-ad703f697b84] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:17.467051 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fe198ccc-fc85-4336-9730-f381f86d9af0 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:17.467493 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fe198ccc-fc85-4336-9730-f381f86d9af0 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:17.468399 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fe198ccc-fc85-4336-9730-f381f86d9af0 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:17.468884 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fe198ccc-fc85-4336-9730-f381f86d9af0 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:17.627809 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-fe198ccc-fc85-4336-9730-f381f86d9af0 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:17.636383 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-fe198ccc-fc85-4336-9730-f381f86d9af0 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/8a2d2dde-ab10-41d4-ab33-ad703f697b84" status: 200 len: 1367 microversion: 2.1 time: 0.180878 May 26 18:06:17.636983 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 312/660] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:06:17 2022] GET /compute/v2.1/servers/8a2d2dde-ab10-41d4-ab33-ad703f697b84 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:17.850123 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-e239b45e-97c3-4330-818d-06d3afe70466 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:17.850636 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-e239b45e-97c3-4330-818d-06d3afe70466 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: 8c73af69-886c-4f22-a6d3-001f566d3277] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:17.857308 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e239b45e-97c3-4330-818d-06d3afe70466 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:17.857754 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e239b45e-97c3-4330-818d-06d3afe70466 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:17.858696 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e239b45e-97c3-4330-818d-06d3afe70466 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:17.859202 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e239b45e-97c3-4330-818d-06d3afe70466 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:18.007757 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-e239b45e-97c3-4330-818d-06d3afe70466 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683ec43ae844757883a7dd5003b53d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a75cf80284f58b9c3bed674677a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:18.017001 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-e239b45e-97c3-4330-818d-06d3afe70466 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "GET /compute/v2.1/servers/8c73af69-886c-4f22-a6d3-001f566d3277" status: 200 len: 1265 microversion: 2.1 time: 0.172062 May 26 18:06:18.017825 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 349/661] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:06:17 2022] GET /compute/v2.1/servers/8c73af69-886c-4f22-a6d3-001f566d3277 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:18.083301 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-2f9c7684-0631-425c-899b-5a3b623ecc26 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:18.084477 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-2f9c7684-0631-425c-899b-5a3b623ecc26 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:18.091331 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2f9c7684-0631-425c-899b-5a3b623ecc26 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:18.091786 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2f9c7684-0631-425c-899b-5a3b623ecc26 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:18.092608 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2f9c7684-0631-425c-899b-5a3b623ecc26 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:18.093058 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2f9c7684-0631-425c-899b-5a3b623ecc26 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:18.244307 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-2f9c7684-0631-425c-899b-5a3b623ecc26 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:18.252503 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-2f9c7684-0631-425c-899b-5a3b623ecc26 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1671 microversion: 2.1 time: 0.173261 May 26 18:06:18.253091 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 313/662] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:06:18 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1671 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:18.314373 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-4e29d9a4-4d6d-458f-a322-44490caf5200 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:18.315821 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-4e29d9a4-4d6d-458f-a322-44490caf5200 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:18.331575 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-4e29d9a4-4d6d-458f-a322-44490caf5200 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:18.332703 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-4e29d9a4-4d6d-458f-a322-44490caf5200 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:18.334125 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-4e29d9a4-4d6d-458f-a322-44490caf5200 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:18.334935 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-4e29d9a4-4d6d-458f-a322-44490caf5200 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:18.513078 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-4e29d9a4-4d6d-458f-a322-44490caf5200 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:18.522276 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-4e29d9a4-4d6d-458f-a322-44490caf5200 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:18.523788 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-4e29d9a4-4d6d-458f-a322-44490caf5200 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:18.524958 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-4e29d9a4-4d6d-458f-a322-44490caf5200 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1404 microversion: 2.20 time: 0.219798 May 26 18:06:18.525534 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 350/663] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:06:18 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1404 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:06:18.655475 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-92ff8f10-6237-4ac4-84bf-a356e4e287f6 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:18.656140 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-92ff8f10-6237-4ac4-84bf-a356e4e287f6 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 8a2d2dde-ab10-41d4-ab33-ad703f697b84] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:18.658254 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell0:SELECT=2 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:18.659403 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell0:SELECT=14 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:18.660568 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=2,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:18.668332 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-92ff8f10-6237-4ac4-84bf-a356e4e287f6 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:18.668795 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-92ff8f10-6237-4ac4-84bf-a356e4e287f6 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:18.669593 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-92ff8f10-6237-4ac4-84bf-a356e4e287f6 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:18.670096 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-92ff8f10-6237-4ac4-84bf-a356e4e287f6 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:19.038374 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-3cb7d23b-fd6d-4183-9c43-4431c5055a1c tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:19.038920 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-3cb7d23b-fd6d-4183-9c43-4431c5055a1c tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: 8c73af69-886c-4f22-a6d3-001f566d3277] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:19.042373 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_cell0:SELECT=18 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:19.052557 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3cb7d23b-fd6d-4183-9c43-4431c5055a1c tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:19.053783 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3cb7d23b-fd6d-4183-9c43-4431c5055a1c tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:19.055528 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3cb7d23b-fd6d-4183-9c43-4431c5055a1c tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:19.056678 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3cb7d23b-fd6d-4183-9c43-4431c5055a1c tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:19.438661 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-92ff8f10-6237-4ac4-84bf-a356e4e287f6 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:19.533687 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-3cb7d23b-fd6d-4183-9c43-4431c5055a1c tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683ec43ae844757883a7dd5003b53d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a75cf80284f58b9c3bed674677a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:19.543197 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-92ff8f10-6237-4ac4-84bf-a356e4e287f6 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/8a2d2dde-ab10-41d4-ab33-ad703f697b84" status: 200 len: 1367 microversion: 2.1 time: 0.892339 May 26 18:06:19.545319 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-3cb7d23b-fd6d-4183-9c43-4431c5055a1c tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "GET /compute/v2.1/servers/8c73af69-886c-4f22-a6d3-001f566d3277" status: 200 len: 1265 microversion: 2.1 time: 0.514027 May 26 18:06:19.550343 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 351/664] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:06:19 2022] GET /compute/v2.1/servers/8c73af69-886c-4f22-a6d3-001f566d3277 => generated 1265 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:19.558222 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 314/665] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:06:18 2022] GET /compute/v2.1/servers/8a2d2dde-ab10-41d4-ab33-ad703f697b84 => generated 1367 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:19.564495 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [req-e7107908-a1b2-432c-bb06-250fddd1a241 req-c7129a3c-aef6-4df0-b2f9-e779e90855bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a2d2dde-ab10-41d4-ab33-ad703f697b84", "name": "network-vif-plugged", "status": "completed", "tag": "def34736-9172-4fd2-aaf3-a11444afd3f9"}]} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:06:19.586719 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-e7107908-a1b2-432c-bb06-250fddd1a241 req-c7129a3c-aef6-4df0-b2f9-e779e90855bf service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:19.587362 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-e7107908-a1b2-432c-bb06-250fddd1a241 req-c7129a3c-aef6-4df0-b2f9-e779e90855bf service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:19.593496 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-776cabd7-a16a-4681-b934-b869b7c86be2 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:19.595156 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-776cabd7-a16a-4681-b934-b869b7c86be2 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:19.612925 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.compute.server_external_events [req-e7107908-a1b2-432c-bb06-250fddd1a241 req-c7129a3c-aef6-4df0-b2f9-e779e90855bf service nova] Creating event network-vif-plugged:def34736-9172-4fd2-aaf3-a11444afd3f9 for instance 8a2d2dde-ab10-41d4-ab33-ad703f697b84 on hv-cinder-83607 May 26 18:06:19.614270 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-776cabd7-a16a-4681-b934-b869b7c86be2 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:19.618136 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [req-e7107908-a1b2-432c-bb06-250fddd1a241 req-c7129a3c-aef6-4df0-b2f9-e779e90855bf service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065440 May 26 18:06:19.618956 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-776cabd7-a16a-4681-b934-b869b7c86be2 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:19.619222 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 352/666] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:06:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:06:19.620163 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-776cabd7-a16a-4681-b934-b869b7c86be2 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:19.620819 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-776cabd7-a16a-4681-b934-b869b7c86be2 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:19.625261 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-befbb073-2003-48c3-97ed-3c1f1efce7f6 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:19.625957 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-befbb073-2003-48c3-97ed-3c1f1efce7f6 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:19.634133 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-befbb073-2003-48c3-97ed-3c1f1efce7f6 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:19.635540 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-befbb073-2003-48c3-97ed-3c1f1efce7f6 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:19.636603 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-befbb073-2003-48c3-97ed-3c1f1efce7f6 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:19.637241 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-befbb073-2003-48c3-97ed-3c1f1efce7f6 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:20.039242 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-776cabd7-a16a-4681-b934-b869b7c86be2 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:20.040225 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-befbb073-2003-48c3-97ed-3c1f1efce7f6 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:20.050545 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-befbb073-2003-48c3-97ed-3c1f1efce7f6 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:20.057803 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-befbb073-2003-48c3-97ed-3c1f1efce7f6 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:20.058992 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-776cabd7-a16a-4681-b934-b869b7c86be2 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1671 microversion: 2.1 time: 0.499537 May 26 18:06:20.060736 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 315/667] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:06:19 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1671 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:20.061819 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-befbb073-2003-48c3-97ed-3c1f1efce7f6 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1404 microversion: 2.20 time: 0.441286 May 26 18:06:20.064891 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 353/668] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:06:19 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1404 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:06:20.568552 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-d9f4cf5f-4e8c-4bf1-b3b7-e22056cbe56f tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:20.569821 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-46fbfc6e-7a3f-4802-89c9-19538b3a78ec tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:20.570482 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-d9f4cf5f-4e8c-4bf1-b3b7-e22056cbe56f tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: 8c73af69-886c-4f22-a6d3-001f566d3277] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:20.570876 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-46fbfc6e-7a3f-4802-89c9-19538b3a78ec tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 8a2d2dde-ab10-41d4-ab33-ad703f697b84] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:20.577752 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d9f4cf5f-4e8c-4bf1-b3b7-e22056cbe56f tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:20.578516 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d9f4cf5f-4e8c-4bf1-b3b7-e22056cbe56f tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:20.579472 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d9f4cf5f-4e8c-4bf1-b3b7-e22056cbe56f tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:20.580340 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d9f4cf5f-4e8c-4bf1-b3b7-e22056cbe56f tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:20.583030 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-46fbfc6e-7a3f-4802-89c9-19538b3a78ec tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:20.583959 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-46fbfc6e-7a3f-4802-89c9-19538b3a78ec tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:20.585256 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-46fbfc6e-7a3f-4802-89c9-19538b3a78ec tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:20.586213 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-46fbfc6e-7a3f-4802-89c9-19538b3a78ec tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:20.746278 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-d9f4cf5f-4e8c-4bf1-b3b7-e22056cbe56f tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683ec43ae844757883a7dd5003b53d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a75cf80284f58b9c3bed674677a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:20.760316 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-d9f4cf5f-4e8c-4bf1-b3b7-e22056cbe56f tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "GET /compute/v2.1/servers/8c73af69-886c-4f22-a6d3-001f566d3277" status: 200 len: 1265 microversion: 2.1 time: 0.196414 May 26 18:06:20.771923 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 316/669] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:06:20 2022] GET /compute/v2.1/servers/8c73af69-886c-4f22-a6d3-001f566d3277 => generated 1265 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:06:20.845226 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-46fbfc6e-7a3f-4802-89c9-19538b3a78ec tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:20.854912 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-46fbfc6e-7a3f-4802-89c9-19538b3a78ec tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/8a2d2dde-ab10-41d4-ab33-ad703f697b84" status: 200 len: 1367 microversion: 2.1 time: 0.291260 May 26 18:06:20.855662 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 354/670] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:06:20 2022] GET /compute/v2.1/servers/8a2d2dde-ab10-41d4-ab33-ad703f697b84 => generated 1367 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:21.058553 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-b9ef9e3c-07c2-4572-b339-52c9531a2443 req-58dbf1a5-69ce-4adc-ae7d-ec8cc6fc01e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcca8b79-ed51-48fa-85ad-4af0a09f7c20", "name": "network-vif-deleted", "tag": "b29d6acf-04aa-4714-90fd-8db0f59d3e5c"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:06:21.081876 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-69f19760-430a-4524-9669-2e12fd6a3e0e tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:21.088652 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-b9ef9e3c-07c2-4572-b339-52c9531a2443 req-58dbf1a5-69ce-4adc-ae7d-ec8cc6fc01e8 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:21.089791 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-b9ef9e3c-07c2-4572-b339-52c9531a2443 req-58dbf1a5-69ce-4adc-ae7d-ec8cc6fc01e8 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:21.089975 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-69f19760-430a-4524-9669-2e12fd6a3e0e tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:21.110739 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-69f19760-430a-4524-9669-2e12fd6a3e0e tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:21.111532 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-69f19760-430a-4524-9669-2e12fd6a3e0e tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:21.112623 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-69f19760-430a-4524-9669-2e12fd6a3e0e tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:21.116250 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-b9ef9e3c-07c2-4572-b339-52c9531a2443 req-58dbf1a5-69ce-4adc-ae7d-ec8cc6fc01e8 service nova] Creating event network-vif-deleted:b29d6acf-04aa-4714-90fd-8db0f59d3e5c for instance bcca8b79-ed51-48fa-85ad-4af0a09f7c20 on hv-cinder-83607 May 26 18:06:21.116863 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-69f19760-430a-4524-9669-2e12fd6a3e0e tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:21.125542 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-b9ef9e3c-07c2-4572-b339-52c9531a2443 req-58dbf1a5-69ce-4adc-ae7d-ec8cc6fc01e8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072939 May 26 18:06:21.126509 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 317/671] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:06:21.152857 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-56d4172e-d358-40aa-8194-776df547b39c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:21.154194 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-56d4172e-d358-40aa-8194-776df547b39c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:21.177437 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-56d4172e-d358-40aa-8194-776df547b39c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:21.178231 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-56d4172e-d358-40aa-8194-776df547b39c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:21.180162 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-56d4172e-d358-40aa-8194-776df547b39c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:21.181171 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-56d4172e-d358-40aa-8194-776df547b39c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:21.231373 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-69f19760-430a-4524-9669-2e12fd6a3e0e tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:21.243598 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-69f19760-430a-4524-9669-2e12fd6a3e0e tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 200 len: 1321 microversion: 2.1 time: 0.169383 May 26 18:06:21.251402 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 355/672] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:06:21 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:06:21.340299 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-56d4172e-d358-40aa-8194-776df547b39c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:21.349565 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-56d4172e-d358-40aa-8194-776df547b39c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:21.351096 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-56d4172e-d358-40aa-8194-776df547b39c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:21.352337 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-56d4172e-d358-40aa-8194-776df547b39c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1404 microversion: 2.20 time: 0.223950 May 26 18:06:21.352970 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 318/673] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:06:21 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1404 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:06:21.787311 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-b932c0af-5e61-4bdc-b4a9-27356a7d269f tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:21.787977 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-b932c0af-5e61-4bdc-b4a9-27356a7d269f tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: 8c73af69-886c-4f22-a6d3-001f566d3277] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:21.795165 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b932c0af-5e61-4bdc-b4a9-27356a7d269f tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:21.795655 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b932c0af-5e61-4bdc-b4a9-27356a7d269f tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:21.796493 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b932c0af-5e61-4bdc-b4a9-27356a7d269f tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:21.796942 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b932c0af-5e61-4bdc-b4a9-27356a7d269f tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:21.873008 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-e40fd399-4e6b-45b4-9a15-826e88a607a8 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:21.874243 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-e40fd399-4e6b-45b4-9a15-826e88a607a8 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 8a2d2dde-ab10-41d4-ab33-ad703f697b84] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:21.882661 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e40fd399-4e6b-45b4-9a15-826e88a607a8 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:21.882661 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e40fd399-4e6b-45b4-9a15-826e88a607a8 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:21.883500 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e40fd399-4e6b-45b4-9a15-826e88a607a8 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:21.884639 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e40fd399-4e6b-45b4-9a15-826e88a607a8 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:21.951482 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-b932c0af-5e61-4bdc-b4a9-27356a7d269f tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683ec43ae844757883a7dd5003b53d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a75cf80284f58b9c3bed674677a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:21.965909 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-b932c0af-5e61-4bdc-b4a9-27356a7d269f tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "GET /compute/v2.1/servers/8c73af69-886c-4f22-a6d3-001f566d3277" status: 200 len: 1265 microversion: 2.1 time: 0.182641 May 26 18:06:21.971269 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 356/674] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:06:21 2022] GET /compute/v2.1/servers/8c73af69-886c-4f22-a6d3-001f566d3277 => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:22.064821 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-e40fd399-4e6b-45b4-9a15-826e88a607a8 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:22.077950 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-e40fd399-4e6b-45b4-9a15-826e88a607a8 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/8a2d2dde-ab10-41d4-ab33-ad703f697b84" status: 200 len: 1558 microversion: 2.1 time: 0.208923 May 26 18:06:22.086326 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 319/675] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:06:21 2022] GET /compute/v2.1/servers/8a2d2dde-ab10-41d4-ab33-ad703f697b84 => generated 1558 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:06:22.095178 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [req-7ff6628a-0f9c-48ba-bacc-bf40bb5bd773 req-3bb0f239-0364-443b-9861-7962fd1e9cbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09d62436-ae28-4b39-90d2-4530f04e4f66", "name": "network-vif-plugged", "status": "completed", "tag": "4f4d056e-de52-4943-ab5b-725a0214cc05"}]} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:06:22.115502 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-20a72764-d6bd-4410-abd8-47f851fa66a8 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:22.116176 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-20a72764-d6bd-4410-abd8-47f851fa66a8 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 8a2d2dde-ab10-41d4-ab33-ad703f697b84] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:22.119617 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-7ff6628a-0f9c-48ba-bacc-bf40bb5bd773 req-3bb0f239-0364-443b-9861-7962fd1e9cbc service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:22.120259 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-7ff6628a-0f9c-48ba-bacc-bf40bb5bd773 req-3bb0f239-0364-443b-9861-7962fd1e9cbc service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:22.129378 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-20a72764-d6bd-4410-abd8-47f851fa66a8 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:22.130005 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-20a72764-d6bd-4410-abd8-47f851fa66a8 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:22.131109 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-20a72764-d6bd-4410-abd8-47f851fa66a8 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:22.131706 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-20a72764-d6bd-4410-abd8-47f851fa66a8 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:22.141828 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.compute.server_external_events [req-7ff6628a-0f9c-48ba-bacc-bf40bb5bd773 req-3bb0f239-0364-443b-9861-7962fd1e9cbc service nova] Creating event network-vif-plugged:4f4d056e-de52-4943-ab5b-725a0214cc05 for instance 09d62436-ae28-4b39-90d2-4530f04e4f66 on hv-cinder-83607 May 26 18:06:22.149253 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [req-7ff6628a-0f9c-48ba-bacc-bf40bb5bd773 req-3bb0f239-0364-443b-9861-7962fd1e9cbc service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057614 May 26 18:06:22.150398 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 357/676] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:06:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:06:22.246433 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-20a72764-d6bd-4410-abd8-47f851fa66a8 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/8a2d2dde-ab10-41d4-ab33-ad703f697b84/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.148652 May 26 18:06:22.247363 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 320/677] 10.222.0.69 () {58 vars in 1274 bytes} [Thu May 26 18:06:22 2022] GET /compute/v2.1/servers/8a2d2dde-ab10-41d4-ab33-ad703f697b84/os-interface => generated 285 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:06:22.264884 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-cf225bd6-9db5-4ce1-afe3-b7248589623c tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:22.266072 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-cf225bd6-9db5-4ce1-afe3-b7248589623c tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:22.278559 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-cf225bd6-9db5-4ce1-afe3-b7248589623c tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:22.279436 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-cf225bd6-9db5-4ce1-afe3-b7248589623c tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:22.280618 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-cf225bd6-9db5-4ce1-afe3-b7248589623c tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:22.281280 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-cf225bd6-9db5-4ce1-afe3-b7248589623c tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:22.325273 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.wsgi [None req-cf225bd6-9db5-4ce1-afe3-b7248589623c tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] HTTP exception thrown: Instance bcca8b79-ed51-48fa-85ad-4af0a09f7c20 could not be found. May 26 18:06:22.327344 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-cf225bd6-9db5-4ce1-afe3-b7248589623c tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Request method failure captured: May 26 18:06:22.327344 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: request: GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 HTTP/1.1 May 26 18:06:22.327344 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Accept: application/json May 26 18:06:22.327344 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Accept-Encoding: identity May 26 18:06:22.327344 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Connection: close May 26 18:06:22.327344 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Content-Length: 0 May 26 18:06:22.327344 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Content-Type: application/json May 26 18:06:22.327344 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Host: 10.222.0.69 May 26 18:06:22.327344 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Openstack-System-Scope: None May 26 18:06:22.327344 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: User-Agent: python-urllib3/1.26.9 May 26 18:06:22.327344 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Auth-Token: gAAAAABij8B3uh9t7vqZRIDnO5VGBgaQWrMP8RxBRpRaFtHMjc8Z4DbyE-hYwUMvA2jrF3XpbWCKCd5Z7a9I_DVY_c4_xnssNbVBomDYrAAlG74nxuhsZb-WEkqdyXP0Z9JyyMLWkSbb04Ly9GF3uniaAtJBGfmUy9d3lO6xsXB-xqYX1fGih5s May 26 18:06:22.327344 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Domain-Id: None May 26 18:06:22.327344 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Domain-Name: None May 26 18:06:22.327344 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Identity-Status: Confirmed May 26 18:06:22.327344 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Is-Admin-Project: True May 26 18:06:22.327344 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Domain-Id: default May 26 18:06:22.327344 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Domain-Name: Default May 26 18:06:22.327344 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Id: 79f8f4d1e7da4bfe9629717a86ba0def May 26 18:06:22.327344 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Name: tempest-AttachVolumeTestJSON-1926902253 May 26 18:06:22.327344 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Role: member,reader May 26 18:06:22.327344 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Roles: member,reader May 26 18:06:22.329345 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/79f8f4d1e7da4bfe9629717a86ba0def"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/79f8f4d1e7da4bfe9629717a86ba0def"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/79f8f4d1e7da4bfe9629717a86ba0def"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_79f8f4d1e7da4bfe9629717a86ba0def"}]}] May 26 18:06:22.329345 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant: tempest-AttachVolumeTestJSON-1926902253 May 26 18:06:22.329345 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant-Id: 79f8f4d1e7da4bfe9629717a86ba0def May 26 18:06:22.329345 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1926902253 May 26 18:06:22.329345 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User: tempest-AttachVolumeTestJSON-1926902253-project May 26 18:06:22.329345 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Domain-Id: default May 26 18:06:22.329345 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Domain-Name: Default May 26 18:06:22.329345 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Id: a95761f42af64635b051051e397d0fd1 May 26 18:06:22.329345 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Name: tempest-AttachVolumeTestJSON-1926902253-project May 26 18:06:22.329345 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: method: > May 26 18:06:22.329345 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: exception: Instance bcca8b79-ed51-48fa-85ad-4af0a09f7c20 could not be found. May 26 18:06:22.329345 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: action_args: {'id': 'bcca8b79-ed51-48fa-85ad-4af0a09f7c20'} May 26 18:06:22.330404 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:06:22.330404 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:06:22.330404 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:06:22.330404 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:06:22.330404 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:06:22.330404 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:06:22.330404 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:06:22.330404 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:06:22.330404 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:06:22.330404 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:06:22.330404 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcca8b79-ed51-48fa-85ad-4af0a09f7c20 could not be found. May 26 18:06:22.330404 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:06:22.330404 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:06:22.330404 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:06:22.330404 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:06:22.330404 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:06:22.330404 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:06:22.330404 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:06:22.330404 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:06:22.330404 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:06:22.332150 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:06:22.332150 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:06:22.332150 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:06:22.332150 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:06:22.332150 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:06:22.332150 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:06:22.332150 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:06:22.332150 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcca8b79-ed51-48fa-85ad-4af0a09f7c20 could not be found. May 26 18:06:22.332150 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:06:22.332150 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:06:22.332150 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:06:22.332150 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:06:22.332150 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:06:22.332150 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:06:22.332150 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:06:22.332150 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:06:22.332150 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcca8b79-ed51-48fa-85ad-4af0a09f7c20 could not be found. May 26 18:06:22.332150 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:06:22.333643 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-cf225bd6-9db5-4ce1-afe3-b7248589623c tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Returning 404 to user: Instance bcca8b79-ed51-48fa-85ad-4af0a09f7c20 could not be found. {{(pid=117722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:06:22.334450 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-cf225bd6-9db5-4ce1-afe3-b7248589623c tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 404 len: 111 microversion: 2.1 time: 0.076829 May 26 18:06:22.335494 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 358/678] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:06:22 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 18:06:22.343638 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-0426dc76-f2cf-42cc-82d7-2331d2571568 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '.version_select at 0x7f3ab8b9ee50>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:22.372854 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-1cc3a381-d4de-4cf0-bc2b-38ebb590a33a tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:22.375371 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-1cc3a381-d4de-4cf0-bc2b-38ebb590a33a tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:22.379616 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-0426dc76-f2cf-42cc-82d7-2331d2571568 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1311237862" status: 202 len: 0 microversion: 2.1 time: 0.039669 May 26 18:06:22.380523 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 321/679] 10.222.0.69 () {58 vars in 1220 bytes} [Thu May 26 18:06:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1311237862 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:06:22.394357 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-1cc3a381-d4de-4cf0-bc2b-38ebb590a33a tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:22.396728 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-1cc3a381-d4de-4cf0-bc2b-38ebb590a33a tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:22.398538 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-1cc3a381-d4de-4cf0-bc2b-38ebb590a33a tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:22.400195 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-1cc3a381-d4de-4cf0-bc2b-38ebb590a33a tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:22.608405 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-1cc3a381-d4de-4cf0-bc2b-38ebb590a33a tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:22.620594 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-1cc3a381-d4de-4cf0-bc2b-38ebb590a33a tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:22.623133 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-1cc3a381-d4de-4cf0-bc2b-38ebb590a33a tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:22.624376 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-1cc3a381-d4de-4cf0-bc2b-38ebb590a33a tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1404 microversion: 2.20 time: 0.257086 May 26 18:06:22.624958 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 359/680] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:06:22 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1404 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:06:22.985006 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-0f26b82f-bb63-4a3c-aa53-aa7cab638d3c tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:22.985726 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-0f26b82f-bb63-4a3c-aa53-aa7cab638d3c tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: 8c73af69-886c-4f22-a6d3-001f566d3277] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:22.992585 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0f26b82f-bb63-4a3c-aa53-aa7cab638d3c tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:22.993126 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0f26b82f-bb63-4a3c-aa53-aa7cab638d3c tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:22.993984 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0f26b82f-bb63-4a3c-aa53-aa7cab638d3c tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:22.994506 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0f26b82f-bb63-4a3c-aa53-aa7cab638d3c tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:23.427084 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-0f26b82f-bb63-4a3c-aa53-aa7cab638d3c tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683ec43ae844757883a7dd5003b53d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a75cf80284f58b9c3bed674677a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:23.437807 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-0f26b82f-bb63-4a3c-aa53-aa7cab638d3c tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "GET /compute/v2.1/servers/8c73af69-886c-4f22-a6d3-001f566d3277" status: 200 len: 1265 microversion: 2.1 time: 0.455876 May 26 18:06:23.438411 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 322/681] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:06:22 2022] GET /compute/v2.1/servers/8c73af69-886c-4f22-a6d3-001f566d3277 => generated 1265 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:23.777425 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-52079d21-1877-4841-9557-1497a894e72f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:23.777425 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-52079d21-1877-4841-9557-1497a894e72f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:23.779790 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-52079d21-1877-4841-9557-1497a894e72f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:23.780307 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-52079d21-1877-4841-9557-1497a894e72f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:23.781141 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-52079d21-1877-4841-9557-1497a894e72f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:23.781579 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-52079d21-1877-4841-9557-1497a894e72f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:23.956260 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-74b4efbc-be1f-488e-89b4-9a5e2aa296cc tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Action: 'create', calling method: .version_select at 0x7f3ab8b9e9d0>, body: {"keypair": {"name": "tempest-keypair-1485702798", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP6mjBTFbwY4eFQmAbxEp5NwnpXqofKEX59OCjvbpDMw66FmU7nGORzdInBXOFv89G9Q2r0Jx+VOZy/VOj6cpv0NUEo/Tc0ZKxJzrDvUMqh1mBVWQ1WNFCsbB3zOpYjigw=="}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:06:23.971749 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-74b4efbc-be1f-488e-89b4-9a5e2aa296cc tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Getting quotas for project 79f8f4d1e7da4bfe9629717a86ba0def. Resources: {'key_pairs'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:06:23.977222 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-74b4efbc-be1f-488e-89b4-9a5e2aa296cc tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Getting quotas for user a95761f42af64635b051051e397d0fd1 and project 79f8f4d1e7da4bfe9629717a86ba0def. Resources: {'key_pairs'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:06:23.978932 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-52079d21-1877-4841-9557-1497a894e72f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:23.987849 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-52079d21-1877-4841-9557-1497a894e72f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:23.991299 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-52079d21-1877-4841-9557-1497a894e72f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:23.992850 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-52079d21-1877-4841-9557-1497a894e72f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1596 microversion: 2.20 time: 0.353750 May 26 18:06:23.993685 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 360/682] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:06:23 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1596 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:06:24.004410 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-74b4efbc-be1f-488e-89b4-9a5e2aa296cc tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052569 May 26 18:06:24.011277 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 323/683] 10.222.0.69 () {60 vars in 1158 bytes} [Thu May 26 18:06:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:06:24.017929 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-d7bc8835-c115-42c0-9dd4-92f2bc6c547c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:24.018506 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-d7bc8835-c115-42c0-9dd4-92f2bc6c547c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:24.036893 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d7bc8835-c115-42c0-9dd4-92f2bc6c547c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:24.038753 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d7bc8835-c115-42c0-9dd4-92f2bc6c547c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:24.049810 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d7bc8835-c115-42c0-9dd4-92f2bc6c547c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:24.049810 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d7bc8835-c115-42c0-9dd4-92f2bc6c547c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:24.076614 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-5426adc0-d0a6-46af-bc9d-af1836c9b3ba req-b5b2c6c0-7631-491b-abf8-046445ea8f5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a2d2dde-ab10-41d4-ab33-ad703f697b84", "tag": "def34736-9172-4fd2-aaf3-a11444afd3f9"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:06:24.086980 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-5426adc0-d0a6-46af-bc9d-af1836c9b3ba req-b5b2c6c0-7631-491b-abf8-046445ea8f5c service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:24.087461 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-5426adc0-d0a6-46af-bc9d-af1836c9b3ba req-b5b2c6c0-7631-491b-abf8-046445ea8f5c service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:24.107106 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-5426adc0-d0a6-46af-bc9d-af1836c9b3ba req-b5b2c6c0-7631-491b-abf8-046445ea8f5c service nova] Creating event network-changed:def34736-9172-4fd2-aaf3-a11444afd3f9 for instance 8a2d2dde-ab10-41d4-ab33-ad703f697b84 on hv-cinder-83607 May 26 18:06:24.116395 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-5426adc0-d0a6-46af-bc9d-af1836c9b3ba req-b5b2c6c0-7631-491b-abf8-046445ea8f5c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043752 May 26 18:06:24.117752 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 324/684] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:06:24.183021 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-4e8a192f-8b02-4f86-976b-d3c51836c747 req-0ec119d8-bb78-491f-a192-701f3a3926ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c73af69-886c-4f22-a6d3-001f566d3277", "name": "network-vif-plugged", "status": "completed", "tag": "0be12dc6-5e46-49db-9a74-e8a86e2b117d"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:06:24.194926 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-4e8a192f-8b02-4f86-976b-d3c51836c747 req-0ec119d8-bb78-491f-a192-701f3a3926ad service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:24.194926 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-4e8a192f-8b02-4f86-976b-d3c51836c747 req-0ec119d8-bb78-491f-a192-701f3a3926ad service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:24.209509 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-4e8a192f-8b02-4f86-976b-d3c51836c747 req-0ec119d8-bb78-491f-a192-701f3a3926ad service nova] Creating event network-vif-plugged:0be12dc6-5e46-49db-9a74-e8a86e2b117d for instance 8c73af69-886c-4f22-a6d3-001f566d3277 on hv-cinder-83607 May 26 18:06:24.215371 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-4e8a192f-8b02-4f86-976b-d3c51836c747 req-0ec119d8-bb78-491f-a192-701f3a3926ad service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038809 May 26 18:06:24.217025 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 325/685] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:06:24.229734 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-d7bc8835-c115-42c0-9dd4-92f2bc6c547c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.217069 May 26 18:06:24.230337 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 361/686] 10.222.0.69 () {60 vars in 1315 bytes} [Thu May 26 18:06:24 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66/os-interface => generated 284 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 18:06:24.457044 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-58af6985-da3d-4358-a3ef-152c4824ce59 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:24.457969 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-58af6985-da3d-4358-a3ef-152c4824ce59 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: 8c73af69-886c-4f22-a6d3-001f566d3277] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:24.471280 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-58af6985-da3d-4358-a3ef-152c4824ce59 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:24.471737 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-58af6985-da3d-4358-a3ef-152c4824ce59 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:24.474344 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-58af6985-da3d-4358-a3ef-152c4824ce59 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:24.475132 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-58af6985-da3d-4358-a3ef-152c4824ce59 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:24.838166 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-58af6985-da3d-4358-a3ef-152c4824ce59 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683ec43ae844757883a7dd5003b53d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a75cf80284f58b9c3bed674677a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:24.848867 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-58af6985-da3d-4358-a3ef-152c4824ce59 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "GET /compute/v2.1/servers/8c73af69-886c-4f22-a6d3-001f566d3277" status: 200 len: 1265 microversion: 2.1 time: 0.397401 May 26 18:06:24.858789 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 326/687] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:06:24 2022] GET /compute/v2.1/servers/8c73af69-886c-4f22-a6d3-001f566d3277 => generated 1265 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:25.868338 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-d4a635a9-ae40-4904-b0cf-b360c5a3e5f9 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:25.869062 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-d4a635a9-ae40-4904-b0cf-b360c5a3e5f9 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: 8c73af69-886c-4f22-a6d3-001f566d3277] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:25.875732 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d4a635a9-ae40-4904-b0cf-b360c5a3e5f9 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:25.876220 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d4a635a9-ae40-4904-b0cf-b360c5a3e5f9 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:25.877186 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d4a635a9-ae40-4904-b0cf-b360c5a3e5f9 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:25.878424 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d4a635a9-ae40-4904-b0cf-b360c5a3e5f9 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:26.062781 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-d4a635a9-ae40-4904-b0cf-b360c5a3e5f9 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683ec43ae844757883a7dd5003b53d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a75cf80284f58b9c3bed674677a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:26.068941 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_cell1:SELECT=100 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:26.079132 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-d4a635a9-ae40-4904-b0cf-b360c5a3e5f9 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "GET /compute/v2.1/servers/8c73af69-886c-4f22-a6d3-001f566d3277" status: 200 len: 1265 microversion: 2.1 time: 0.217025 May 26 18:06:26.079734 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 362/688] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:06:25 2022] GET /compute/v2.1/servers/8c73af69-886c-4f22-a6d3-001f566d3277 => generated 1265 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:26.155684 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-e2ecd69b-d0b5-47e1-b515-71ea8c35cbfd req-2bb5f4c8-631d-40db-94d5-1a7414a35808 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09d62436-ae28-4b39-90d2-4530f04e4f66", "tag": "4f4d056e-de52-4943-ab5b-725a0214cc05"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:06:26.167049 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-e2ecd69b-d0b5-47e1-b515-71ea8c35cbfd req-2bb5f4c8-631d-40db-94d5-1a7414a35808 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:26.167913 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-e2ecd69b-d0b5-47e1-b515-71ea8c35cbfd req-2bb5f4c8-631d-40db-94d5-1a7414a35808 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:26.183812 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-e2ecd69b-d0b5-47e1-b515-71ea8c35cbfd req-2bb5f4c8-631d-40db-94d5-1a7414a35808 service nova] Creating event network-changed:4f4d056e-de52-4943-ab5b-725a0214cc05 for instance 09d62436-ae28-4b39-90d2-4530f04e4f66 on hv-cinder-83607 May 26 18:06:26.190161 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-e2ecd69b-d0b5-47e1-b515-71ea8c35cbfd req-2bb5f4c8-631d-40db-94d5-1a7414a35808 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038218 May 26 18:06:26.191146 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 327/689] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:06:26.763342 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-0a27aa43-ed63-4e72-b678-17d9c8f6eae6 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-611586043", "imageRef": "16351c96-cb02-4711-99d5-fd4d80e8a846", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0bfb788b-88d8-4bf1-bef0-c0a994bf6666"}], "security_groups": [{"name": "tempest-securitygroup--1975741140"}], "key_name": "tempest-keypair-1485702798", "user_data": "}} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:06:26.979355 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.network.neutron [None req-0a27aa43-ed63-4e72-b678-17d9c8f6eae6 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] validate_networks() for [('0bfb788b-88d8-4bf1-bef0-c0a994bf6666', None, None, None, None, None)] {{(pid=117722) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:06:27.103273 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-41a0df18-0d61-4621-8e94-de55a5ab1030 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:27.104230 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-41a0df18-0d61-4621-8e94-de55a5ab1030 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: 8c73af69-886c-4f22-a6d3-001f566d3277] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:27.112596 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-41a0df18-0d61-4621-8e94-de55a5ab1030 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:27.114173 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-41a0df18-0d61-4621-8e94-de55a5ab1030 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:27.115322 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-41a0df18-0d61-4621-8e94-de55a5ab1030 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:27.116124 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-41a0df18-0d61-4621-8e94-de55a5ab1030 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:27.318699 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-41a0df18-0d61-4621-8e94-de55a5ab1030 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683ec43ae844757883a7dd5003b53d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a75cf80284f58b9c3bed674677a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:27.325243 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:27.336541 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-41a0df18-0d61-4621-8e94-de55a5ab1030 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "GET /compute/v2.1/servers/8c73af69-886c-4f22-a6d3-001f566d3277" status: 200 len: 1452 microversion: 2.1 time: 0.240380 May 26 18:06:27.338205 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 328/690] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:06:27 2022] GET /compute/v2.1/servers/8c73af69-886c-4f22-a6d3-001f566d3277 => generated 1452 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:27.361706 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-ce85a5f6-c0c5-4ec0-ac41-6483e2223cba tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:27.362234 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-ce85a5f6-c0c5-4ec0-ac41-6483e2223cba tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: 8c73af69-886c-4f22-a6d3-001f566d3277] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:27.381221 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ce85a5f6-c0c5-4ec0-ac41-6483e2223cba tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:27.381984 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ce85a5f6-c0c5-4ec0-ac41-6483e2223cba tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:27.384436 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ce85a5f6-c0c5-4ec0-ac41-6483e2223cba tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:27.384988 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ce85a5f6-c0c5-4ec0-ac41-6483e2223cba tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:27.593862 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-ce85a5f6-c0c5-4ec0-ac41-6483e2223cba tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683ec43ae844757883a7dd5003b53d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a75cf80284f58b9c3bed674677a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:27.604598 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-ce85a5f6-c0c5-4ec0-ac41-6483e2223cba tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "GET /compute/v2.1/servers/8c73af69-886c-4f22-a6d3-001f566d3277" status: 200 len: 1452 microversion: 2.1 time: 0.248062 May 26 18:06:27.617595 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 329/691] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:06:27 2022] GET /compute/v2.1/servers/8c73af69-886c-4f22-a6d3-001f566d3277 => generated 1452 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:06:27.679751 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.virt.hardware [None req-0a27aa43-ed63-4e72-b678-17d9c8f6eae6 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Flavor limits 0:0:0 {{(pid=117722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:06:27.680621 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.virt.hardware [None req-0a27aa43-ed63-4e72-b678-17d9c8f6eae6 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Image limits 0:0:0 {{(pid=117722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:06:27.681396 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.virt.hardware [None req-0a27aa43-ed63-4e72-b678-17d9c8f6eae6 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Flavor pref 0:0:0 {{(pid=117722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:06:27.681831 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.virt.hardware [None req-0a27aa43-ed63-4e72-b678-17d9c8f6eae6 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Image pref 0:0:0 {{(pid=117722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:06:27.682258 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.virt.hardware [None req-0a27aa43-ed63-4e72-b678-17d9c8f6eae6 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:06:27.694044 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0a27aa43-ed63-4e72-b678-17d9c8f6eae6 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:27.694583 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0a27aa43-ed63-4e72-b678-17d9c8f6eae6 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:27.695488 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0a27aa43-ed63-4e72-b678-17d9c8f6eae6 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:27.696004 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0a27aa43-ed63-4e72-b678-17d9c8f6eae6 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:27.723731 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.quota [None req-0a27aa43-ed63-4e72-b678-17d9c8f6eae6 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Getting quotas for project 79f8f4d1e7da4bfe9629717a86ba0def. Resources: {'instances', 'ram', 'cores'} {{(pid=117722) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:06:27.731678 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.quota [None req-0a27aa43-ed63-4e72-b678-17d9c8f6eae6 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Getting quotas for user a95761f42af64635b051051e397d0fd1 and project 79f8f4d1e7da4bfe9629717a86ba0def. Resources: {'instances', 'ram', 'cores'} {{(pid=117722) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:06:27.752217 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-0a27aa43-ed63-4e72-b678-17d9c8f6eae6 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Going to run 1 instances... {{(pid=117722) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:06:27.757926 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-0a27aa43-ed63-4e72-b678-17d9c8f6eae6 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: 00f290f6-5aaa-4234-ac0b-094f19c94959] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='16351c96-cb02-4711-99d5-fd4d80e8a846',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:06:27.812652 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-0a27aa43-ed63-4e72-b678-17d9c8f6eae6 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.061907 May 26 18:06:27.813386 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 363/692] 10.222.0.69 () {60 vars in 1146 bytes} [Thu May 26 18:06:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 1064 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 18:06:27.827548 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-11c28478-3ebb-4503-9891-d0fab964c8e7 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:27.828830 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-11c28478-3ebb-4503-9891-d0fab964c8e7 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: 00f290f6-5aaa-4234-ac0b-094f19c94959] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:27.899774 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-11c28478-3ebb-4503-9891-d0fab964c8e7 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:27.907345 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-11c28478-3ebb-4503-9891-d0fab964c8e7 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959" status: 200 len: 1237 microversion: 2.1 time: 0.083891 May 26 18:06:27.908539 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 330/693] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:06:27 2022] GET /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959 => generated 1237 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:29.024642 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-9b732726-122c-4882-9d79-f53e627bd10f tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:29.025537 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-9b732726-122c-4882-9d79-f53e627bd10f tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: 00f290f6-5aaa-4234-ac0b-094f19c94959] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:29.036763 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-9b732726-122c-4882-9d79-f53e627bd10f tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:29.037226 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-9b732726-122c-4882-9d79-f53e627bd10f tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:29.038039 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-9b732726-122c-4882-9d79-f53e627bd10f tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:29.038481 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-9b732726-122c-4882-9d79-f53e627bd10f tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:29.147401 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-9b732726-122c-4882-9d79-f53e627bd10f tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:29.157448 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-9b732726-122c-4882-9d79-f53e627bd10f tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959" status: 200 len: 1289 microversion: 2.1 time: 0.233023 May 26 18:06:29.167562 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 364/694] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:06:28 2022] GET /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959 => generated 1289 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:30.177137 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-322fe7a0-37f1-4ffe-91be-112a7b6ba9a6 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:30.178033 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-322fe7a0-37f1-4ffe-91be-112a7b6ba9a6 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: 00f290f6-5aaa-4234-ac0b-094f19c94959] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:30.191516 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-322fe7a0-37f1-4ffe-91be-112a7b6ba9a6 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:30.192345 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-322fe7a0-37f1-4ffe-91be-112a7b6ba9a6 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:30.193818 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-322fe7a0-37f1-4ffe-91be-112a7b6ba9a6 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:30.194604 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-322fe7a0-37f1-4ffe-91be-112a7b6ba9a6 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:30.303311 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-322fe7a0-37f1-4ffe-91be-112a7b6ba9a6 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:30.313713 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-322fe7a0-37f1-4ffe-91be-112a7b6ba9a6 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959" status: 200 len: 1295 microversion: 2.1 time: 0.143183 May 26 18:06:30.314580 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 331/695] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:06:30 2022] GET /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959 => generated 1295 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:30.568063 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [req-5a642ee0-93d1-4f8f-adb1-a73e645b79a4 req-2d4e14a3-ebed-466c-8a0a-d51ea1dfd1cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c73af69-886c-4f22-a6d3-001f566d3277", "tag": "0be12dc6-5e46-49db-9a74-e8a86e2b117d"}]} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:06:30.587183 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-5a642ee0-93d1-4f8f-adb1-a73e645b79a4 req-2d4e14a3-ebed-466c-8a0a-d51ea1dfd1cf service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:30.588485 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-5a642ee0-93d1-4f8f-adb1-a73e645b79a4 req-2d4e14a3-ebed-466c-8a0a-d51ea1dfd1cf service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:30.615166 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.compute.server_external_events [req-5a642ee0-93d1-4f8f-adb1-a73e645b79a4 req-2d4e14a3-ebed-466c-8a0a-d51ea1dfd1cf service nova] Creating event network-changed:0be12dc6-5e46-49db-9a74-e8a86e2b117d for instance 8c73af69-886c-4f22-a6d3-001f566d3277 on hv-cinder-83607 May 26 18:06:30.623824 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [req-5a642ee0-93d1-4f8f-adb1-a73e645b79a4 req-2d4e14a3-ebed-466c-8a0a-d51ea1dfd1cf service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064132 May 26 18:06:30.624839 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 365/696] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:06:31.337596 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-75b3ea06-34af-4931-9ec0-46b6d69c5dc6 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:31.339539 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-75b3ea06-34af-4931-9ec0-46b6d69c5dc6 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: 00f290f6-5aaa-4234-ac0b-094f19c94959] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:31.352765 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-75b3ea06-34af-4931-9ec0-46b6d69c5dc6 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:31.353628 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-75b3ea06-34af-4931-9ec0-46b6d69c5dc6 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:31.355142 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-75b3ea06-34af-4931-9ec0-46b6d69c5dc6 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:31.355949 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-75b3ea06-34af-4931-9ec0-46b6d69c5dc6 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:31.569778 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-75b3ea06-34af-4931-9ec0-46b6d69c5dc6 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:31.587696 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-75b3ea06-34af-4931-9ec0-46b6d69c5dc6 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959" status: 200 len: 1363 microversion: 2.1 time: 0.256020 May 26 18:06:31.588551 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 332/697] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:06:31 2022] GET /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959 => generated 1363 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:32.612402 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-bf0d5da4-143f-4be6-8c76-cd3ddb49fb8c tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:32.613967 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-bf0d5da4-143f-4be6-8c76-cd3ddb49fb8c tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: 00f290f6-5aaa-4234-ac0b-094f19c94959] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:32.622410 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-bf0d5da4-143f-4be6-8c76-cd3ddb49fb8c tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:32.623043 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-bf0d5da4-143f-4be6-8c76-cd3ddb49fb8c tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:32.624397 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-bf0d5da4-143f-4be6-8c76-cd3ddb49fb8c tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:32.624940 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-bf0d5da4-143f-4be6-8c76-cd3ddb49fb8c tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:32.647929 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-d13de2ff-bc94-47c3-a491-503dbc0b4a7c req-2ddd6cb1-911b-4f43-8762-a9515811de86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00f290f6-5aaa-4234-ac0b-094f19c94959", "tag": "74ee7604-84aa-483d-8a81-f801b551e03a"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:06:32.658253 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-d13de2ff-bc94-47c3-a491-503dbc0b4a7c req-2ddd6cb1-911b-4f43-8762-a9515811de86 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:32.658707 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-d13de2ff-bc94-47c3-a491-503dbc0b4a7c req-2ddd6cb1-911b-4f43-8762-a9515811de86 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:32.672751 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-d13de2ff-bc94-47c3-a491-503dbc0b4a7c req-2ddd6cb1-911b-4f43-8762-a9515811de86 service nova] Creating event network-changed:74ee7604-84aa-483d-8a81-f801b551e03a for instance 00f290f6-5aaa-4234-ac0b-094f19c94959 on hv-cinder-83607 May 26 18:06:32.679319 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-d13de2ff-bc94-47c3-a491-503dbc0b4a7c req-2ddd6cb1-911b-4f43-8762-a9515811de86 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035330 May 26 18:06:32.679945 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 333/698] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:06:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:06:32.936435 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-bf0d5da4-143f-4be6-8c76-cd3ddb49fb8c tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:32.944955 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-bf0d5da4-143f-4be6-8c76-cd3ddb49fb8c tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959" status: 200 len: 1363 microversion: 2.1 time: 0.339581 May 26 18:06:32.945631 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 366/699] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:06:32 2022] GET /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959 => generated 1363 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:33.965727 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-36e99821-ea37-497b-8981-31e2bf4e12a8 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:33.966350 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-36e99821-ea37-497b-8981-31e2bf4e12a8 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: 00f290f6-5aaa-4234-ac0b-094f19c94959] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:33.974700 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-36e99821-ea37-497b-8981-31e2bf4e12a8 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:33.975160 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-36e99821-ea37-497b-8981-31e2bf4e12a8 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:33.976007 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-36e99821-ea37-497b-8981-31e2bf4e12a8 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:33.976480 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-36e99821-ea37-497b-8981-31e2bf4e12a8 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:34.160837 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-36e99821-ea37-497b-8981-31e2bf4e12a8 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:34.169276 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-36e99821-ea37-497b-8981-31e2bf4e12a8 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959" status: 200 len: 1363 microversion: 2.1 time: 0.208929 May 26 18:06:34.169882 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 334/700] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:06:33 2022] GET /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959 => generated 1363 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:35.187236 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-c161b5cf-31b0-482c-803a-5b599bc33072 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:35.189197 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-c161b5cf-31b0-482c-803a-5b599bc33072 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: 00f290f6-5aaa-4234-ac0b-094f19c94959] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:35.196141 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c161b5cf-31b0-482c-803a-5b599bc33072 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:35.196383 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c161b5cf-31b0-482c-803a-5b599bc33072 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:35.197247 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c161b5cf-31b0-482c-803a-5b599bc33072 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:35.197994 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c161b5cf-31b0-482c-803a-5b599bc33072 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:35.391468 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-c161b5cf-31b0-482c-803a-5b599bc33072 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:35.401401 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-c161b5cf-31b0-482c-803a-5b599bc33072 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959" status: 200 len: 1363 microversion: 2.1 time: 0.218381 May 26 18:06:35.401999 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 367/701] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:06:35 2022] GET /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959 => generated 1363 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:36.419506 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-bab1b325-cdf4-46ae-9b4a-9d2d5ca0e774 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:36.420155 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-bab1b325-cdf4-46ae-9b4a-9d2d5ca0e774 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: 00f290f6-5aaa-4234-ac0b-094f19c94959] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:36.434037 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-bab1b325-cdf4-46ae-9b4a-9d2d5ca0e774 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:36.434507 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-bab1b325-cdf4-46ae-9b4a-9d2d5ca0e774 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:36.435324 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-bab1b325-cdf4-46ae-9b4a-9d2d5ca0e774 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:36.435770 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-bab1b325-cdf4-46ae-9b4a-9d2d5ca0e774 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:36.587980 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-bab1b325-cdf4-46ae-9b4a-9d2d5ca0e774 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:36.596522 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-bab1b325-cdf4-46ae-9b4a-9d2d5ca0e774 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959" status: 200 len: 1363 microversion: 2.1 time: 0.180785 May 26 18:06:36.597396 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 335/702] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:06:36 2022] GET /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959 => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:37.183559 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [req-9a611015-3608-47ac-bc60-e2b4dbf57d28 req-c3c9b5b0-090d-41c9-b9ec-a33773bff910 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00f290f6-5aaa-4234-ac0b-094f19c94959", "name": "network-vif-plugged", "status": "completed", "tag": "74ee7604-84aa-483d-8a81-f801b551e03a"}]} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:06:37.201895 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-9a611015-3608-47ac-bc60-e2b4dbf57d28 req-c3c9b5b0-090d-41c9-b9ec-a33773bff910 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:37.202656 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-9a611015-3608-47ac-bc60-e2b4dbf57d28 req-c3c9b5b0-090d-41c9-b9ec-a33773bff910 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:37.226253 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.compute.server_external_events [req-9a611015-3608-47ac-bc60-e2b4dbf57d28 req-c3c9b5b0-090d-41c9-b9ec-a33773bff910 service nova] Creating event network-vif-plugged:74ee7604-84aa-483d-8a81-f801b551e03a for instance 00f290f6-5aaa-4234-ac0b-094f19c94959 on hv-cinder-83607 May 26 18:06:37.235395 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [req-9a611015-3608-47ac-bc60-e2b4dbf57d28 req-c3c9b5b0-090d-41c9-b9ec-a33773bff910 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059469 May 26 18:06:37.236552 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 368/703] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:06:37.615705 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-874a9520-cfea-4c02-9d96-16186eb478aa tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:37.616467 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-874a9520-cfea-4c02-9d96-16186eb478aa tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: 00f290f6-5aaa-4234-ac0b-094f19c94959] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:37.623610 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-874a9520-cfea-4c02-9d96-16186eb478aa tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:37.624247 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-874a9520-cfea-4c02-9d96-16186eb478aa tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:37.625017 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-874a9520-cfea-4c02-9d96-16186eb478aa tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:37.625449 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-874a9520-cfea-4c02-9d96-16186eb478aa tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:37.768743 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-874a9520-cfea-4c02-9d96-16186eb478aa tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:37.777403 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-874a9520-cfea-4c02-9d96-16186eb478aa tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959" status: 200 len: 1363 microversion: 2.1 time: 0.166370 May 26 18:06:37.778036 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 336/704] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:06:37 2022] GET /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:38.792237 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_cell0:SELECT=2 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:38.793040 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_cell0:SELECT=6 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:38.798588 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-9b602813-7ca1-4846-b2a8-50cec5d90686 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:38.799517 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-9b602813-7ca1-4846-b2a8-50cec5d90686 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: 00f290f6-5aaa-4234-ac0b-094f19c94959] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:38.807869 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-9b602813-7ca1-4846-b2a8-50cec5d90686 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:38.808404 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-9b602813-7ca1-4846-b2a8-50cec5d90686 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:38.809219 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-9b602813-7ca1-4846-b2a8-50cec5d90686 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:38.809665 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-9b602813-7ca1-4846-b2a8-50cec5d90686 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:38.992487 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-9b602813-7ca1-4846-b2a8-50cec5d90686 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:39.006259 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-9b602813-7ca1-4846-b2a8-50cec5d90686 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959" status: 200 len: 1363 microversion: 2.1 time: 0.214475 May 26 18:06:39.007245 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 369/705] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:06:38 2022] GET /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959 => generated 1363 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:40.031855 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-df40ea9f-5c38-47e2-a7ee-db8efb66ce66 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:40.032448 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-df40ea9f-5c38-47e2-a7ee-db8efb66ce66 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: 00f290f6-5aaa-4234-ac0b-094f19c94959] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:40.034537 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell0:SELECT=6 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:40.040856 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-df40ea9f-5c38-47e2-a7ee-db8efb66ce66 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:40.041313 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-df40ea9f-5c38-47e2-a7ee-db8efb66ce66 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:40.042137 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-df40ea9f-5c38-47e2-a7ee-db8efb66ce66 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:40.042585 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-df40ea9f-5c38-47e2-a7ee-db8efb66ce66 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:40.186766 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-df40ea9f-5c38-47e2-a7ee-db8efb66ce66 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:40.195007 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-df40ea9f-5c38-47e2-a7ee-db8efb66ce66 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959" status: 200 len: 1548 microversion: 2.1 time: 0.167074 May 26 18:06:40.195632 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 337/706] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:06:40 2022] GET /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959 => generated 1548 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:40.212595 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-32e285dd-caa3-46e6-8981-dd519f465f1a tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:40.213199 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-32e285dd-caa3-46e6-8981-dd519f465f1a tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: 00f290f6-5aaa-4234-ac0b-094f19c94959] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:40.220138 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-32e285dd-caa3-46e6-8981-dd519f465f1a tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:40.220599 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-32e285dd-caa3-46e6-8981-dd519f465f1a tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:40.221389 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-32e285dd-caa3-46e6-8981-dd519f465f1a tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:40.221832 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-32e285dd-caa3-46e6-8981-dd519f465f1a tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:40.307827 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-32e285dd-caa3-46e6-8981-dd519f465f1a tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099551 May 26 18:06:40.308467 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 370/707] 10.222.0.69 () {58 vars in 1274 bytes} [Thu May 26 18:06:40 2022] GET /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:06:41.404877 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-1bf3404e-04ea-425d-a763-180caf7fce43 req-4047fa3b-197b-4e09-82c6-6a5c64704d86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00f290f6-5aaa-4234-ac0b-094f19c94959", "tag": "74ee7604-84aa-483d-8a81-f801b551e03a"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:06:41.415829 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-1bf3404e-04ea-425d-a763-180caf7fce43 req-4047fa3b-197b-4e09-82c6-6a5c64704d86 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:41.416482 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-1bf3404e-04ea-425d-a763-180caf7fce43 req-4047fa3b-197b-4e09-82c6-6a5c64704d86 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:41.429050 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-1bf3404e-04ea-425d-a763-180caf7fce43 req-4047fa3b-197b-4e09-82c6-6a5c64704d86 service nova] Creating event network-changed:74ee7604-84aa-483d-8a81-f801b551e03a for instance 00f290f6-5aaa-4234-ac0b-094f19c94959 on hv-cinder-83607 May 26 18:06:41.435427 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-1bf3404e-04ea-425d-a763-180caf7fce43 req-4047fa3b-197b-4e09-82c6-6a5c64704d86 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034166 May 26 18:06:41.436079 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 338/708] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:06:47.594567 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-60af7602-f825-4053-acd0-90d40c0d291d tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:47.595235 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-60af7602-f825-4053-acd0-90d40c0d291d tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 704b23df-a1e8-425f-a6bf-4805b1356866] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:47.598520 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:47.610892 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-60af7602-f825-4053-acd0-90d40c0d291d tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:47.612632 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-60af7602-f825-4053-acd0-90d40c0d291d tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:47.614837 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-60af7602-f825-4053-acd0-90d40c0d291d tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:47.616062 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-60af7602-f825-4053-acd0-90d40c0d291d tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:47.747154 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.objects.instance [None req-60af7602-f825-4053-acd0-90d40c0d291d tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lazy-loading 'services' on Instance uuid 704b23df-a1e8-425f-a6bf-4805b1356866 {{(pid=117722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:06:47.835653 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-60af7602-f825-4053-acd0-90d40c0d291d tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "DELETE /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866/os-volume_attachments/90236f05-8d50-4481-aa60-e8f63e231893" status: 202 len: 0 microversion: 2.1 time: 0.246568 May 26 18:06:47.836350 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 371/709] 10.222.0.69 () {58 vars in 1415 bytes} [Thu May 26 18:06:47 2022] DELETE /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866/os-volume_attachments/90236f05-8d50-4481-aa60-e8f63e231893 => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:06:47.854807 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-aefaf461-21bb-4c89-bdd7-9594d1c1a923 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:47.857297 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-aefaf461-21bb-4c89-bdd7-9594d1c1a923 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 704b23df-a1e8-425f-a6bf-4805b1356866] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:47.874541 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-aefaf461-21bb-4c89-bdd7-9594d1c1a923 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:47.875706 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-aefaf461-21bb-4c89-bdd7-9594d1c1a923 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:47.877295 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-aefaf461-21bb-4c89-bdd7-9594d1c1a923 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:47.878941 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-aefaf461-21bb-4c89-bdd7-9594d1c1a923 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:47.929163 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-aefaf461-21bb-4c89-bdd7-9594d1c1a923 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086464 May 26 18:06:47.929906 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 339/710] 10.222.0.69 () {58 vars in 1301 bytes} [Thu May 26 18:06:47 2022] GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:06:48.945272 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-02d3ec82-d379-4a08-915f-e1e2ac7369a9 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:48.946289 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-02d3ec82-d379-4a08-915f-e1e2ac7369a9 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 704b23df-a1e8-425f-a6bf-4805b1356866] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:48.953413 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-02d3ec82-d379-4a08-915f-e1e2ac7369a9 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:48.953874 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-02d3ec82-d379-4a08-915f-e1e2ac7369a9 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:48.954680 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-02d3ec82-d379-4a08-915f-e1e2ac7369a9 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:48.955127 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-02d3ec82-d379-4a08-915f-e1e2ac7369a9 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:48.990885 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-02d3ec82-d379-4a08-915f-e1e2ac7369a9 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051559 May 26 18:06:48.991861 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 372/711] 10.222.0.69 () {58 vars in 1301 bytes} [Thu May 26 18:06:48 2022] GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 18:06:49.077128 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-59b5fdc6-9dc5-4371-946f-169114f91667 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:49.077732 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-59b5fdc6-9dc5-4371-946f-169114f91667 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 704b23df-a1e8-425f-a6bf-4805b1356866] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:49.080232 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:49.088338 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-59b5fdc6-9dc5-4371-946f-169114f91667 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:49.088892 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-59b5fdc6-9dc5-4371-946f-169114f91667 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:49.089880 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-59b5fdc6-9dc5-4371-946f-169114f91667 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:49.090371 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-59b5fdc6-9dc5-4371-946f-169114f91667 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:49.121520 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-59b5fdc6-9dc5-4371-946f-169114f91667 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 704b23df-a1e8-425f-a6bf-4805b1356866] Going to try to terminate instance {{(pid=117723) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:06:49.217054 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-59b5fdc6-9dc5-4371-946f-169114f91667 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "DELETE /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866" status: 204 len: 0 microversion: 2.1 time: 0.143208 May 26 18:06:49.217685 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 340/712] 10.222.0.69 () {58 vars in 1238 bytes} [Thu May 26 18:06:49 2022] DELETE /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 18:06:49.226545 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-33514824-9050-4c9d-94d4-9f168b1591c7 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:49.227178 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-33514824-9050-4c9d-94d4-9f168b1591c7 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 704b23df-a1e8-425f-a6bf-4805b1356866] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:49.234040 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-33514824-9050-4c9d-94d4-9f168b1591c7 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:49.234501 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-33514824-9050-4c9d-94d4-9f168b1591c7 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:49.235326 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-33514824-9050-4c9d-94d4-9f168b1591c7 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:49.235775 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-33514824-9050-4c9d-94d4-9f168b1591c7 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:49.389258 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-33514824-9050-4c9d-94d4-9f168b1591c7 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:49.397835 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-33514824-9050-4c9d-94d4-9f168b1591c7 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866" status: 200 len: 1689 microversion: 2.1 time: 0.175378 May 26 18:06:49.398421 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 373/713] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:06:49 2022] GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866 => generated 1689 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:50.416360 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-b232ffcc-7397-4024-9baa-f29120cb983f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:50.417003 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-b232ffcc-7397-4024-9baa-f29120cb983f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 704b23df-a1e8-425f-a6bf-4805b1356866] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:50.424186 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b232ffcc-7397-4024-9baa-f29120cb983f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:50.424636 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b232ffcc-7397-4024-9baa-f29120cb983f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:50.425446 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b232ffcc-7397-4024-9baa-f29120cb983f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:50.426019 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b232ffcc-7397-4024-9baa-f29120cb983f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:50.579230 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-b232ffcc-7397-4024-9baa-f29120cb983f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:50.588598 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-b232ffcc-7397-4024-9baa-f29120cb983f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866" status: 200 len: 1689 microversion: 2.1 time: 0.176584 May 26 18:06:50.589326 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 341/714] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:06:50 2022] GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866 => generated 1689 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:51.606884 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-0fce914b-d819-466c-8295-441e75c21c0f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:51.607541 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-0fce914b-d819-466c-8295-441e75c21c0f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 704b23df-a1e8-425f-a6bf-4805b1356866] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:51.615381 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0fce914b-d819-466c-8295-441e75c21c0f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:51.615831 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0fce914b-d819-466c-8295-441e75c21c0f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:51.616667 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0fce914b-d819-466c-8295-441e75c21c0f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:51.617119 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0fce914b-d819-466c-8295-441e75c21c0f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:51.769719 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-0fce914b-d819-466c-8295-441e75c21c0f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:51.777896 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-0fce914b-d819-466c-8295-441e75c21c0f tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866" status: 200 len: 1689 microversion: 2.1 time: 0.174886 May 26 18:06:51.778840 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 374/715] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:06:51 2022] GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866 => generated 1689 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:52.797304 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-c7a82cbe-15dd-4b82-b979-5c5ff9bab7a0 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:52.798088 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-c7a82cbe-15dd-4b82-b979-5c5ff9bab7a0 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 704b23df-a1e8-425f-a6bf-4805b1356866] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:52.807127 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c7a82cbe-15dd-4b82-b979-5c5ff9bab7a0 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:52.807477 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c7a82cbe-15dd-4b82-b979-5c5ff9bab7a0 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:52.808312 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c7a82cbe-15dd-4b82-b979-5c5ff9bab7a0 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:52.808757 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c7a82cbe-15dd-4b82-b979-5c5ff9bab7a0 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:52.958955 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-c7a82cbe-15dd-4b82-b979-5c5ff9bab7a0 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:52.967223 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-c7a82cbe-15dd-4b82-b979-5c5ff9bab7a0 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866" status: 200 len: 1689 microversion: 2.1 time: 0.173839 May 26 18:06:52.967986 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 342/716] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:06:52 2022] GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866 => generated 1689 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:06:53.985226 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-80f8b138-34f5-46af-9601-ebce67ecb37d tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:53.985911 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-80f8b138-34f5-46af-9601-ebce67ecb37d tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 704b23df-a1e8-425f-a6bf-4805b1356866] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:53.993460 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-80f8b138-34f5-46af-9601-ebce67ecb37d tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:53.994147 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-80f8b138-34f5-46af-9601-ebce67ecb37d tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:53.995057 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-80f8b138-34f5-46af-9601-ebce67ecb37d tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:53.995504 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-80f8b138-34f5-46af-9601-ebce67ecb37d tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:54.095243 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-80f8b138-34f5-46af-9601-ebce67ecb37d tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:54.108157 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-80f8b138-34f5-46af-9601-ebce67ecb37d tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866" status: 200 len: 1621 microversion: 2.1 time: 0.126055 May 26 18:06:54.109255 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 375/717] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:06:53 2022] GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866 => generated 1621 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:06:54.321760 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-01e1934e-ad03-4700-a68e-bf66b7e90b3a req-246b84c7-8da2-43cc-9580-1e0f7a444fdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "704b23df-a1e8-425f-a6bf-4805b1356866", "name": "network-vif-deleted", "tag": "b3168a60-01f6-45c3-989d-b7db5593ac6f"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:06:54.341429 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-01e1934e-ad03-4700-a68e-bf66b7e90b3a req-246b84c7-8da2-43cc-9580-1e0f7a444fdd service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:54.342571 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-01e1934e-ad03-4700-a68e-bf66b7e90b3a req-246b84c7-8da2-43cc-9580-1e0f7a444fdd service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:54.363631 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-01e1934e-ad03-4700-a68e-bf66b7e90b3a req-246b84c7-8da2-43cc-9580-1e0f7a444fdd service nova] Creating event network-vif-deleted:b3168a60-01f6-45c3-989d-b7db5593ac6f for instance 704b23df-a1e8-425f-a6bf-4805b1356866 on hv-cinder-83607 May 26 18:06:54.373491 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-01e1934e-ad03-4700-a68e-bf66b7e90b3a req-246b84c7-8da2-43cc-9580-1e0f7a444fdd service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162353 May 26 18:06:54.374937 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 343/718] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:06:55.133113 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-03a048d2-82f8-4008-b218-51d736cb0cda tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:55.134170 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-03a048d2-82f8-4008-b218-51d736cb0cda tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 704b23df-a1e8-425f-a6bf-4805b1356866] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:55.141107 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-03a048d2-82f8-4008-b218-51d736cb0cda tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:55.141473 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-03a048d2-82f8-4008-b218-51d736cb0cda tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:55.142156 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-03a048d2-82f8-4008-b218-51d736cb0cda tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:55.142611 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-03a048d2-82f8-4008-b218-51d736cb0cda tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:55.157992 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.wsgi [None req-03a048d2-82f8-4008-b218-51d736cb0cda tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] HTTP exception thrown: Instance 704b23df-a1e8-425f-a6bf-4805b1356866 could not be found. May 26 18:06:55.160588 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-03a048d2-82f8-4008-b218-51d736cb0cda tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Request method failure captured: May 26 18:06:55.160588 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: request: GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866 HTTP/1.1 May 26 18:06:55.160588 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Accept: application/json May 26 18:06:55.160588 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Accept-Encoding: identity May 26 18:06:55.160588 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Connection: close May 26 18:06:55.160588 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Content-Length: 0 May 26 18:06:55.160588 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Content-Type: application/json May 26 18:06:55.160588 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Host: 10.222.0.69 May 26 18:06:55.160588 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Openstack-System-Scope: None May 26 18:06:55.160588 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: User-Agent: python-urllib3/1.26.9 May 26 18:06:55.160588 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Auth-Token: gAAAAABij8CEaLy0mIY1rbl58rC9P5zQJt3SdA29iT72yPdbP2A1cZkxmYRESeVBN9npB9Fyh-TEA-fQEqHl8bqgiGsn4EJRSEgZQOIOcnpWWnEUJaD6JqRSmdBSMdFWgTLV5TzEuYe-QdEGVEJ4qH0zXg8eK_viVaqviW5ytzmptISabYMrRrw May 26 18:06:55.160588 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Domain-Id: None May 26 18:06:55.160588 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Domain-Name: None May 26 18:06:55.160588 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Identity-Status: Confirmed May 26 18:06:55.160588 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Is-Admin-Project: True May 26 18:06:55.160588 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Domain-Id: default May 26 18:06:55.160588 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Domain-Name: Default May 26 18:06:55.160588 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Id: 53288d567a8f426bb068908db481e32e May 26 18:06:55.160588 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-48273316 May 26 18:06:55.160588 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Role: member,reader May 26 18:06:55.160588 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Roles: member,reader May 26 18:06:55.163712 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/53288d567a8f426bb068908db481e32e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/53288d567a8f426bb068908db481e32e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/53288d567a8f426bb068908db481e32e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_53288d567a8f426bb068908db481e32e"}]}] May 26 18:06:55.163712 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant: tempest-ServerRescueNegativeTestJSON-48273316 May 26 18:06:55.163712 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant-Id: 53288d567a8f426bb068908db481e32e May 26 18:06:55.163712 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-48273316 May 26 18:06:55.163712 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User: tempest-ServerRescueNegativeTestJSON-48273316-project May 26 18:06:55.163712 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Domain-Id: default May 26 18:06:55.163712 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Domain-Name: Default May 26 18:06:55.163712 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Id: 5b5c8dedd274447da8ee4600feb6a26c May 26 18:06:55.163712 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Name: tempest-ServerRescueNegativeTestJSON-48273316-project May 26 18:06:55.163712 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: method: > May 26 18:06:55.163712 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: exception: Instance 704b23df-a1e8-425f-a6bf-4805b1356866 could not be found. May 26 18:06:55.163712 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: action_args: {'id': '704b23df-a1e8-425f-a6bf-4805b1356866'} May 26 18:06:55.165366 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:06:55.165366 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:06:55.165366 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:06:55.165366 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:06:55.165366 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:06:55.165366 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:06:55.165366 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:06:55.165366 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:06:55.165366 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:06:55.165366 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:06:55.165366 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 704b23df-a1e8-425f-a6bf-4805b1356866 could not be found. May 26 18:06:55.165366 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:06:55.165366 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:06:55.165366 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:06:55.165366 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:06:55.165366 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:06:55.165366 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:06:55.165366 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:06:55.165366 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:06:55.165366 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:06:55.168889 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:06:55.168889 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:06:55.168889 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:06:55.168889 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:06:55.168889 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:06:55.168889 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:06:55.168889 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:06:55.168889 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 704b23df-a1e8-425f-a6bf-4805b1356866 could not be found. May 26 18:06:55.168889 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:06:55.168889 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:06:55.168889 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:06:55.168889 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:06:55.168889 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:06:55.168889 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:06:55.168889 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:06:55.168889 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:06:55.168889 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 704b23df-a1e8-425f-a6bf-4805b1356866 could not be found. May 26 18:06:55.168889 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:06:55.171904 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-03a048d2-82f8-4008-b218-51d736cb0cda tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Returning 404 to user: Instance 704b23df-a1e8-425f-a6bf-4805b1356866 could not be found. {{(pid=117722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:06:55.171904 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-03a048d2-82f8-4008-b218-51d736cb0cda tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866" status: 404 len: 111 microversion: 2.1 time: 0.033343 May 26 18:06:55.171904 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 376/719] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:06:55 2022] GET /compute/v2.1/servers/704b23df-a1e8-425f-a6bf-4805b1356866 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:06:55.172376 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-9a549ee2-b97f-4cd6-899d-97e51b43ee96 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '.version_select at 0x7f3ab8bed700>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:55.193317 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-9a549ee2-b97f-4cd6-899d-97e51b43ee96 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-508299147" status: 202 len: 0 microversion: 2.1 time: 0.025480 May 26 18:06:55.197381 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 344/720] 10.222.0.69 () {58 vars in 1217 bytes} [Thu May 26 18:06:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-508299147 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:06:58.249915 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-8c9e879a-f6b6-4734-9080-9a91a1e15a9a tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:58.250736 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-8c9e879a-f6b6-4734-9080-9a91a1e15a9a tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:58.258623 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-8c9e879a-f6b6-4734-9080-9a91a1e15a9a tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:58.259072 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-8c9e879a-f6b6-4734-9080-9a91a1e15a9a tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:58.259860 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-8c9e879a-f6b6-4734-9080-9a91a1e15a9a tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:58.260327 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-8c9e879a-f6b6-4734-9080-9a91a1e15a9a tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:58.263481 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_cell1:SELECT=71,nova_cell1:INSERT=1 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:58.291892 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-8c9e879a-f6b6-4734-9080-9a91a1e15a9a tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Going to try to terminate instance {{(pid=117722) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:06:58.393766 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-8c9e879a-f6b6-4734-9080-9a91a1e15a9a tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "DELETE /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 204 len: 0 microversion: 2.1 time: 0.147390 May 26 18:06:58.394415 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 377/721] 10.222.0.69 () {58 vars in 1238 bytes} [Thu May 26 18:06:58 2022] DELETE /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 26 18:06:58.403604 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-30303161-b4c1-4d88-9c0e-05a14b37f1cc tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:58.404391 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-30303161-b4c1-4d88-9c0e-05a14b37f1cc tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:58.411286 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-30303161-b4c1-4d88-9c0e-05a14b37f1cc tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:58.411740 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-30303161-b4c1-4d88-9c0e-05a14b37f1cc tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:58.412562 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-30303161-b4c1-4d88-9c0e-05a14b37f1cc tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:58.412993 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-30303161-b4c1-4d88-9c0e-05a14b37f1cc tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:58.416210 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:58.567928 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-30303161-b4c1-4d88-9c0e-05a14b37f1cc tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:58.576062 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-30303161-b4c1-4d88-9c0e-05a14b37f1cc tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1508 microversion: 2.1 time: 0.176901 May 26 18:06:58.576658 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 345/722] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:06:58 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1508 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:06:59.595597 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-8e3531e7-98a6-42d7-b2ed-9b1d6da16d54 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:59.596716 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-8e3531e7-98a6-42d7-b2ed-9b1d6da16d54 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:59.604443 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-8e3531e7-98a6-42d7-b2ed-9b1d6da16d54 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:59.604953 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-8e3531e7-98a6-42d7-b2ed-9b1d6da16d54 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:59.605795 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-8e3531e7-98a6-42d7-b2ed-9b1d6da16d54 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:59.606286 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-8e3531e7-98a6-42d7-b2ed-9b1d6da16d54 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:59.768739 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-8e3531e7-98a6-42d7-b2ed-9b1d6da16d54 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:59.778983 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-8e3531e7-98a6-42d7-b2ed-9b1d6da16d54 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1508 microversion: 2.1 time: 0.187836 May 26 18:06:59.779662 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 378/723] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:06:59 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1508 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:00.796698 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-ebf80d35-53ca-4a10-be29-8313481bedaa tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:00.797449 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-ebf80d35-53ca-4a10-be29-8313481bedaa tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:00.806134 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ebf80d35-53ca-4a10-be29-8313481bedaa tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:00.806616 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ebf80d35-53ca-4a10-be29-8313481bedaa tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:00.807612 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ebf80d35-53ca-4a10-be29-8313481bedaa tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:00.808180 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ebf80d35-53ca-4a10-be29-8313481bedaa tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:00.965972 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-ebf80d35-53ca-4a10-be29-8313481bedaa tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:00.974721 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-ebf80d35-53ca-4a10-be29-8313481bedaa tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1508 microversion: 2.1 time: 0.181930 May 26 18:07:00.975394 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 346/724] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:07:00 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1508 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:01.878923 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [req-f08b72bc-920d-4911-b8aa-9aa8d120333f req-1c539fd7-413b-4d09-9f10-641a9b7505ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab024be1-042a-4324-9a5e-f66f33a36fc5", "name": "network-vif-deleted", "tag": "6e614e89-75f5-41f4-9d8e-dc40ee2870d3"}]} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:07:01.906750 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-f08b72bc-920d-4911-b8aa-9aa8d120333f req-1c539fd7-413b-4d09-9f10-641a9b7505ad service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:01.908125 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-f08b72bc-920d-4911-b8aa-9aa8d120333f req-1c539fd7-413b-4d09-9f10-641a9b7505ad service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:01.934593 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.compute.server_external_events [req-f08b72bc-920d-4911-b8aa-9aa8d120333f req-1c539fd7-413b-4d09-9f10-641a9b7505ad service nova] Creating event network-vif-deleted:6e614e89-75f5-41f4-9d8e-dc40ee2870d3 for instance ab024be1-042a-4324-9a5e-f66f33a36fc5 on hv-cinder-83607 May 26 18:07:01.944544 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [req-f08b72bc-920d-4911-b8aa-9aa8d120333f req-1c539fd7-413b-4d09-9f10-641a9b7505ad service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073963 May 26 18:07:01.945630 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 379/725] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:07:01.993420 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-42d58807-650c-48f3-8d5f-5f3eec9c81ea tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:01.994328 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-42d58807-650c-48f3-8d5f-5f3eec9c81ea tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:02.001569 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-42d58807-650c-48f3-8d5f-5f3eec9c81ea tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:02.002790 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-42d58807-650c-48f3-8d5f-5f3eec9c81ea tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:02.003413 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-42d58807-650c-48f3-8d5f-5f3eec9c81ea tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:02.003871 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-42d58807-650c-48f3-8d5f-5f3eec9c81ea tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:02.042823 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-42d58807-650c-48f3-8d5f-5f3eec9c81ea tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:02.043281 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-42d58807-650c-48f3-8d5f-5f3eec9c81ea tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:02.043788 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.objects.instance [None req-42d58807-650c-48f3-8d5f-5f3eec9c81ea tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lazy-loading 'fault' on Instance uuid ab024be1-042a-4324-9a5e-f66f33a36fc5 {{(pid=117723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:07:02.090335 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-42d58807-650c-48f3-8d5f-5f3eec9c81ea tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:02.099695 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-42d58807-650c-48f3-8d5f-5f3eec9c81ea tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 200 len: 1312 microversion: 2.1 time: 0.110625 May 26 18:07:02.100345 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 347/726] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:07:01 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 1312 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:03.120224 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-bc2575ef-c6eb-4684-adfa-4e3d6d06c0c8 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:03.121060 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-bc2575ef-c6eb-4684-adfa-4e3d6d06c0c8 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: ab024be1-042a-4324-9a5e-f66f33a36fc5] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:03.128446 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-bc2575ef-c6eb-4684-adfa-4e3d6d06c0c8 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:03.128897 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-bc2575ef-c6eb-4684-adfa-4e3d6d06c0c8 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:03.129705 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-bc2575ef-c6eb-4684-adfa-4e3d6d06c0c8 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:03.130148 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-bc2575ef-c6eb-4684-adfa-4e3d6d06c0c8 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:03.145260 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.wsgi [None req-bc2575ef-c6eb-4684-adfa-4e3d6d06c0c8 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] HTTP exception thrown: Instance ab024be1-042a-4324-9a5e-f66f33a36fc5 could not be found. May 26 18:07:03.146966 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-bc2575ef-c6eb-4684-adfa-4e3d6d06c0c8 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Request method failure captured: May 26 18:07:03.146966 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: request: GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 HTTP/1.1 May 26 18:07:03.146966 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Accept: application/json May 26 18:07:03.146966 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Accept-Encoding: identity May 26 18:07:03.146966 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Connection: close May 26 18:07:03.146966 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Content-Length: 0 May 26 18:07:03.146966 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Content-Type: application/json May 26 18:07:03.146966 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Host: 10.222.0.69 May 26 18:07:03.146966 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Openstack-System-Scope: None May 26 18:07:03.146966 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: User-Agent: python-urllib3/1.26.9 May 26 18:07:03.146966 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Auth-Token: gAAAAABij8CEaLy0mIY1rbl58rC9P5zQJt3SdA29iT72yPdbP2A1cZkxmYRESeVBN9npB9Fyh-TEA-fQEqHl8bqgiGsn4EJRSEgZQOIOcnpWWnEUJaD6JqRSmdBSMdFWgTLV5TzEuYe-QdEGVEJ4qH0zXg8eK_viVaqviW5ytzmptISabYMrRrw May 26 18:07:03.146966 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Domain-Id: None May 26 18:07:03.146966 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Domain-Name: None May 26 18:07:03.146966 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Identity-Status: Confirmed May 26 18:07:03.146966 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Is-Admin-Project: True May 26 18:07:03.146966 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Domain-Id: default May 26 18:07:03.146966 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Domain-Name: Default May 26 18:07:03.146966 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Id: 53288d567a8f426bb068908db481e32e May 26 18:07:03.146966 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-48273316 May 26 18:07:03.146966 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Role: member,reader May 26 18:07:03.146966 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Roles: member,reader May 26 18:07:03.149329 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/53288d567a8f426bb068908db481e32e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/53288d567a8f426bb068908db481e32e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/53288d567a8f426bb068908db481e32e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_53288d567a8f426bb068908db481e32e"}]}] May 26 18:07:03.149329 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant: tempest-ServerRescueNegativeTestJSON-48273316 May 26 18:07:03.149329 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant-Id: 53288d567a8f426bb068908db481e32e May 26 18:07:03.149329 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-48273316 May 26 18:07:03.149329 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User: tempest-ServerRescueNegativeTestJSON-48273316-project May 26 18:07:03.149329 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Domain-Id: default May 26 18:07:03.149329 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Domain-Name: Default May 26 18:07:03.149329 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Id: 5b5c8dedd274447da8ee4600feb6a26c May 26 18:07:03.149329 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Name: tempest-ServerRescueNegativeTestJSON-48273316-project May 26 18:07:03.149329 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: method: > May 26 18:07:03.149329 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: exception: Instance ab024be1-042a-4324-9a5e-f66f33a36fc5 could not be found. May 26 18:07:03.149329 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: action_args: {'id': 'ab024be1-042a-4324-9a5e-f66f33a36fc5'} May 26 18:07:03.150881 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:07:03.150881 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:07:03.150881 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:07:03.150881 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:07:03.150881 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:07:03.150881 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:07:03.150881 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:07:03.150881 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:07:03.150881 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:07:03.150881 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:07:03.150881 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab024be1-042a-4324-9a5e-f66f33a36fc5 could not be found. May 26 18:07:03.150881 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:07:03.150881 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:07:03.150881 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:07:03.150881 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:07:03.150881 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:07:03.150881 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:07:03.150881 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:07:03.150881 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:07:03.150881 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:07:03.153666 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:07:03.153666 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:07:03.153666 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:07:03.153666 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:07:03.153666 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:07:03.153666 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:07:03.153666 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:07:03.153666 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab024be1-042a-4324-9a5e-f66f33a36fc5 could not be found. May 26 18:07:03.153666 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:07:03.153666 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:07:03.153666 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:07:03.153666 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:07:03.153666 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:07:03.153666 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:07:03.153666 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:07:03.153666 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:07:03.153666 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab024be1-042a-4324-9a5e-f66f33a36fc5 could not be found. May 26 18:07:03.153666 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:07:03.155872 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-bc2575ef-c6eb-4684-adfa-4e3d6d06c0c8 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Returning 404 to user: Instance ab024be1-042a-4324-9a5e-f66f33a36fc5 could not be found. {{(pid=117722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:07:03.155872 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-bc2575ef-c6eb-4684-adfa-4e3d6d06c0c8 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5" status: 404 len: 111 microversion: 2.1 time: 0.033276 May 26 18:07:03.155872 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 380/727] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:07:03 2022] GET /compute/v2.1/servers/ab024be1-042a-4324-9a5e-f66f33a36fc5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:07:03.159538 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-93ea8e12-d88e-4d13-af1b-fc189f12fac9 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:03.160127 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-93ea8e12-d88e-4d13-af1b-fc189f12fac9 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 3e617476-1bcd-49f6-b16b-1513445fc759] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:03.167067 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-93ea8e12-d88e-4d13-af1b-fc189f12fac9 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:03.167519 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-93ea8e12-d88e-4d13-af1b-fc189f12fac9 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:03.168347 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-93ea8e12-d88e-4d13-af1b-fc189f12fac9 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:03.168790 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-93ea8e12-d88e-4d13-af1b-fc189f12fac9 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:03.199351 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-93ea8e12-d88e-4d13-af1b-fc189f12fac9 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 3e617476-1bcd-49f6-b16b-1513445fc759] Going to try to terminate instance {{(pid=117723) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:07:03.299646 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-93ea8e12-d88e-4d13-af1b-fc189f12fac9 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "DELETE /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759" status: 204 len: 0 microversion: 2.1 time: 0.142993 May 26 18:07:03.300906 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 348/728] 10.222.0.69 () {58 vars in 1238 bytes} [Thu May 26 18:07:03 2022] DELETE /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 26 18:07:03.315931 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-e68db499-4138-4e11-9070-a656fbc411f3 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:03.316900 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-e68db499-4138-4e11-9070-a656fbc411f3 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 3e617476-1bcd-49f6-b16b-1513445fc759] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:03.326351 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e68db499-4138-4e11-9070-a656fbc411f3 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:03.327144 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e68db499-4138-4e11-9070-a656fbc411f3 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:03.328298 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e68db499-4138-4e11-9070-a656fbc411f3 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:03.328808 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e68db499-4138-4e11-9070-a656fbc411f3 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:03.516431 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-e68db499-4138-4e11-9070-a656fbc411f3 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:03.525614 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-e68db499-4138-4e11-9070-a656fbc411f3 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759" status: 200 len: 1521 microversion: 2.1 time: 0.218041 May 26 18:07:03.526266 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 381/729] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:07:03 2022] GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759 => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:04.545368 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-b7c6ed89-e0c8-4926-ae8e-f01c5d058d42 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:04.546140 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-b7c6ed89-e0c8-4926-ae8e-f01c5d058d42 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 3e617476-1bcd-49f6-b16b-1513445fc759] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:04.554567 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b7c6ed89-e0c8-4926-ae8e-f01c5d058d42 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:04.555021 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b7c6ed89-e0c8-4926-ae8e-f01c5d058d42 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:04.555869 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b7c6ed89-e0c8-4926-ae8e-f01c5d058d42 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:04.556279 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b7c6ed89-e0c8-4926-ae8e-f01c5d058d42 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:04.713752 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-b7c6ed89-e0c8-4926-ae8e-f01c5d058d42 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:04.730529 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-b7c6ed89-e0c8-4926-ae8e-f01c5d058d42 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759" status: 200 len: 1521 microversion: 2.1 time: 0.189019 May 26 18:07:04.731732 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 349/730] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:07:04 2022] GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:07:05.757723 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-fe67948c-82c3-42dd-ab3a-1974632963d6 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:05.758903 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-fe67948c-82c3-42dd-ab3a-1974632963d6 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 3e617476-1bcd-49f6-b16b-1513445fc759] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:05.771368 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-fe67948c-82c3-42dd-ab3a-1974632963d6 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:05.772237 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-fe67948c-82c3-42dd-ab3a-1974632963d6 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:05.773741 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-fe67948c-82c3-42dd-ab3a-1974632963d6 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:05.774562 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-fe67948c-82c3-42dd-ab3a-1974632963d6 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:05.958934 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-fe67948c-82c3-42dd-ab3a-1974632963d6 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:05.973208 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-fe67948c-82c3-42dd-ab3a-1974632963d6 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759" status: 200 len: 1521 microversion: 2.1 time: 0.223299 May 26 18:07:05.974304 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 382/731] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:07:05 2022] GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759 => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:07.003037 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-be015197-a4f5-48d2-be33-edbb29364dac tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:07.004112 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-be015197-a4f5-48d2-be33-edbb29364dac tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 3e617476-1bcd-49f6-b16b-1513445fc759] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:07.011522 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-be015197-a4f5-48d2-be33-edbb29364dac tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:07.011891 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-be015197-a4f5-48d2-be33-edbb29364dac tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:07.012740 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-be015197-a4f5-48d2-be33-edbb29364dac tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:07.013189 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-be015197-a4f5-48d2-be33-edbb29364dac tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:07.074192 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-b8bd0e79-c6be-4993-af5b-09e5df6d030d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:07.075022 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-b8bd0e79-c6be-4993-af5b-09e5df6d030d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:07.089900 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b8bd0e79-c6be-4993-af5b-09e5df6d030d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:07.090430 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b8bd0e79-c6be-4993-af5b-09e5df6d030d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:07.091279 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b8bd0e79-c6be-4993-af5b-09e5df6d030d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:07.091721 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b8bd0e79-c6be-4993-af5b-09e5df6d030d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:07.122103 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-b8bd0e79-c6be-4993-af5b-09e5df6d030d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66/ips" status: 200 len: 152 microversion: 2.20 time: 0.053634 May 26 18:07:07.122780 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 383/732] 10.222.0.69 () {60 vars in 1288 bytes} [Thu May 26 18:07:07 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66/ips => generated 152 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 18:07:07.210429 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-be015197-a4f5-48d2-be33-edbb29364dac tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5c8dedd274447da8ee4600feb6a26c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53288d567a8f426bb068908db481e32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:07.220134 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-be015197-a4f5-48d2-be33-edbb29364dac tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759" status: 200 len: 1521 microversion: 2.1 time: 0.224581 May 26 18:07:07.222580 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 350/733] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:07:06 2022] GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759 => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:07.504747 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [req-b7e9bc60-281a-40bb-a2d3-7062b0bd85e2 req-6cd0c55e-70ba-4f77-b857-88668b0c4f54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e617476-1bcd-49f6-b16b-1513445fc759", "name": "network-vif-deleted", "tag": "efa3e5cd-83db-40dc-825f-91ed2c94a915"}]} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:07:07.516633 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-b7e9bc60-281a-40bb-a2d3-7062b0bd85e2 req-6cd0c55e-70ba-4f77-b857-88668b0c4f54 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:07.517595 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-b7e9bc60-281a-40bb-a2d3-7062b0bd85e2 req-6cd0c55e-70ba-4f77-b857-88668b0c4f54 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:07.552493 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.compute.server_external_events [req-b7e9bc60-281a-40bb-a2d3-7062b0bd85e2 req-6cd0c55e-70ba-4f77-b857-88668b0c4f54 service nova] Creating event network-vif-deleted:efa3e5cd-83db-40dc-825f-91ed2c94a915 for instance 3e617476-1bcd-49f6-b16b-1513445fc759 on hv-cinder-83607 May 26 18:07:07.564405 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [req-b7e9bc60-281a-40bb-a2d3-7062b0bd85e2 req-6cd0c55e-70ba-4f77-b857-88668b0c4f54 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070041 May 26 18:07:07.581182 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 384/734] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:07:08.240459 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-78bd5d30-5099-4d3e-b0ce-d87b8cd1b888 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:08.241455 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-78bd5d30-5099-4d3e-b0ce-d87b8cd1b888 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] [instance: 3e617476-1bcd-49f6-b16b-1513445fc759] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:08.249247 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-78bd5d30-5099-4d3e-b0ce-d87b8cd1b888 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:08.249858 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-78bd5d30-5099-4d3e-b0ce-d87b8cd1b888 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:08.250772 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-78bd5d30-5099-4d3e-b0ce-d87b8cd1b888 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:08.251337 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-78bd5d30-5099-4d3e-b0ce-d87b8cd1b888 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:08.267992 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.wsgi [None req-78bd5d30-5099-4d3e-b0ce-d87b8cd1b888 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] HTTP exception thrown: Instance 3e617476-1bcd-49f6-b16b-1513445fc759 could not be found. May 26 18:07:08.269724 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-78bd5d30-5099-4d3e-b0ce-d87b8cd1b888 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Request method failure captured: May 26 18:07:08.269724 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: request: GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759 HTTP/1.1 May 26 18:07:08.269724 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Accept: application/json May 26 18:07:08.269724 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Accept-Encoding: identity May 26 18:07:08.269724 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Connection: close May 26 18:07:08.269724 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Content-Length: 0 May 26 18:07:08.269724 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Content-Type: application/json May 26 18:07:08.269724 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Host: 10.222.0.69 May 26 18:07:08.269724 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Openstack-System-Scope: None May 26 18:07:08.269724 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: User-Agent: python-urllib3/1.26.9 May 26 18:07:08.269724 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Auth-Token: gAAAAABij8CEaLy0mIY1rbl58rC9P5zQJt3SdA29iT72yPdbP2A1cZkxmYRESeVBN9npB9Fyh-TEA-fQEqHl8bqgiGsn4EJRSEgZQOIOcnpWWnEUJaD6JqRSmdBSMdFWgTLV5TzEuYe-QdEGVEJ4qH0zXg8eK_viVaqviW5ytzmptISabYMrRrw May 26 18:07:08.269724 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Domain-Id: None May 26 18:07:08.269724 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Domain-Name: None May 26 18:07:08.269724 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Identity-Status: Confirmed May 26 18:07:08.269724 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Is-Admin-Project: True May 26 18:07:08.269724 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Domain-Id: default May 26 18:07:08.269724 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Domain-Name: Default May 26 18:07:08.269724 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Id: 53288d567a8f426bb068908db481e32e May 26 18:07:08.269724 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-48273316 May 26 18:07:08.269724 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Role: member,reader May 26 18:07:08.269724 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Roles: member,reader May 26 18:07:08.272119 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/53288d567a8f426bb068908db481e32e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/53288d567a8f426bb068908db481e32e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/53288d567a8f426bb068908db481e32e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_53288d567a8f426bb068908db481e32e"}]}] May 26 18:07:08.272119 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant: tempest-ServerRescueNegativeTestJSON-48273316 May 26 18:07:08.272119 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant-Id: 53288d567a8f426bb068908db481e32e May 26 18:07:08.272119 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-48273316 May 26 18:07:08.272119 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User: tempest-ServerRescueNegativeTestJSON-48273316-project May 26 18:07:08.272119 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Domain-Id: default May 26 18:07:08.272119 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Domain-Name: Default May 26 18:07:08.272119 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Id: 5b5c8dedd274447da8ee4600feb6a26c May 26 18:07:08.272119 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Name: tempest-ServerRescueNegativeTestJSON-48273316-project May 26 18:07:08.272119 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: method: > May 26 18:07:08.272119 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: exception: Instance 3e617476-1bcd-49f6-b16b-1513445fc759 could not be found. May 26 18:07:08.272119 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: action_args: {'id': '3e617476-1bcd-49f6-b16b-1513445fc759'} May 26 18:07:08.273452 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:07:08.273452 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:07:08.273452 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:07:08.273452 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:07:08.273452 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:07:08.273452 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:07:08.273452 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:07:08.273452 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:07:08.273452 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:07:08.273452 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:07:08.273452 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e617476-1bcd-49f6-b16b-1513445fc759 could not be found. May 26 18:07:08.273452 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:07:08.273452 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:07:08.273452 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:07:08.273452 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:07:08.273452 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:07:08.273452 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:07:08.273452 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:07:08.273452 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:07:08.273452 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:07:08.275770 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:07:08.275770 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:07:08.275770 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:07:08.275770 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:07:08.275770 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:07:08.275770 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:07:08.275770 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:07:08.275770 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e617476-1bcd-49f6-b16b-1513445fc759 could not be found. May 26 18:07:08.275770 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:07:08.275770 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:07:08.275770 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:07:08.275770 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:07:08.275770 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:07:08.275770 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:07:08.275770 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:07:08.275770 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:07:08.275770 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e617476-1bcd-49f6-b16b-1513445fc759 could not be found. May 26 18:07:08.275770 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:07:08.278587 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-78bd5d30-5099-4d3e-b0ce-d87b8cd1b888 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] Returning 404 to user: Instance 3e617476-1bcd-49f6-b16b-1513445fc759 could not be found. {{(pid=117723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:07:08.278587 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-78bd5d30-5099-4d3e-b0ce-d87b8cd1b888 tempest-ServerRescueNegativeTestJSON-48273316 tempest-ServerRescueNegativeTestJSON-48273316-project] 10.222.0.69 "GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759" status: 404 len: 111 microversion: 2.1 time: 0.037233 May 26 18:07:08.278587 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 351/735] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:07:08 2022] GET /compute/v2.1/servers/3e617476-1bcd-49f6-b16b-1513445fc759 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 18:07:09.705253 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-971e8cd8-5023-4530-9969-9f3eb1d72eeb tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:09.706303 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-971e8cd8-5023-4530-9969-9f3eb1d72eeb tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 8a2d2dde-ab10-41d4-ab33-ad703f697b84] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:09.717272 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-971e8cd8-5023-4530-9969-9f3eb1d72eeb tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:09.718221 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-971e8cd8-5023-4530-9969-9f3eb1d72eeb tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:09.719242 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-971e8cd8-5023-4530-9969-9f3eb1d72eeb tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:09.719833 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-971e8cd8-5023-4530-9969-9f3eb1d72eeb tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:09.753250 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-971e8cd8-5023-4530-9969-9f3eb1d72eeb tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/8a2d2dde-ab10-41d4-ab33-ad703f697b84/ips" status: 200 len: 151 microversion: 2.1 time: 0.058480 May 26 18:07:09.754572 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 385/736] 10.222.0.69 () {58 vars in 1247 bytes} [Thu May 26 18:07:09 2022] GET /compute/v2.1/servers/8a2d2dde-ab10-41d4-ab33-ad703f697b84/ips => generated 151 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:07:09.932228 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-4f0d17f6-ab66-4000-84d2-bfc98dbf977d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:07:09.933349 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-4f0d17f6-ab66-4000-84d2-bfc98dbf977d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:09.947732 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4f0d17f6-ab66-4000-84d2-bfc98dbf977d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:09.948912 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4f0d17f6-ab66-4000-84d2-bfc98dbf977d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:09.950195 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4f0d17f6-ab66-4000-84d2-bfc98dbf977d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:09.950845 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4f0d17f6-ab66-4000-84d2-bfc98dbf977d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:09.993109 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.objects.instance [None req-4f0d17f6-ab66-4000-84d2-bfc98dbf977d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lazy-loading 'flavor' on Instance uuid 09d62436-ae28-4b39-90d2-4530f04e4f66 {{(pid=117723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:07:10.445249 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-4f0d17f6-ab66-4000-84d2-bfc98dbf977d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "POST /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66/action" status: 202 len: 0 microversion: 2.20 time: 0.523328 May 26 18:07:10.446354 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 352/737] 10.222.0.69 () {62 vars in 1318 bytes} [Thu May 26 18:07:09 2022] POST /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66/action => generated 0 bytes in 525 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 26 18:07:10.461079 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-8f02c557-956a-434c-98bf-951c9c79246a tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:10.462157 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-8f02c557-956a-434c-98bf-951c9c79246a tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:10.474208 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-8f02c557-956a-434c-98bf-951c9c79246a tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:10.475408 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-8f02c557-956a-434c-98bf-951c9c79246a tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:10.476913 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-8f02c557-956a-434c-98bf-951c9c79246a tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:10.477701 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-8f02c557-956a-434c-98bf-951c9c79246a tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:10.689913 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-8f02c557-956a-434c-98bf-951c9c79246a tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:10.707114 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-8f02c557-956a-434c-98bf-951c9c79246a tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:10.711754 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-8f02c557-956a-434c-98bf-951c9c79246a tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:10.714512 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-8f02c557-956a-434c-98bf-951c9c79246a tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1721 microversion: 2.20 time: 0.261431 May 26 18:07:10.716398 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 386/738] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:07:10 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1721 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:07:11.373915 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-cbb650fe-2423-418b-a79d-d0f507cbf860 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e3132350-c40c-455d-95ec-0fd2779de97d"}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:07:11.375970 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-cbb650fe-2423-418b-a79d-d0f507cbf860 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 8a2d2dde-ab10-41d4-ab33-ad703f697b84] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:11.385909 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-cbb650fe-2423-418b-a79d-d0f507cbf860 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:11.386723 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-cbb650fe-2423-418b-a79d-d0f507cbf860 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:11.388265 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-cbb650fe-2423-418b-a79d-d0f507cbf860 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:11.389074 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-cbb650fe-2423-418b-a79d-d0f507cbf860 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:11.744981 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-4236d6f6-229d-477c-844a-32c9e1876675 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:11.746579 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-4236d6f6-229d-477c-844a-32c9e1876675 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:11.758430 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-4236d6f6-229d-477c-844a-32c9e1876675 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:11.759351 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-4236d6f6-229d-477c-844a-32c9e1876675 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:11.760413 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-4236d6f6-229d-477c-844a-32c9e1876675 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:11.761087 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-4236d6f6-229d-477c-844a-32c9e1876675 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:11.822023 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-cbb650fe-2423-418b-a79d-d0f507cbf860 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "POST /compute/v2.1/servers/8a2d2dde-ab10-41d4-ab33-ad703f697b84/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.452463 May 26 18:07:11.824199 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 353/739] 10.222.0.69 () {60 vars in 1322 bytes} [Thu May 26 18:07:11 2022] POST /compute/v2.1/servers/8a2d2dde-ab10-41d4-ab33-ad703f697b84/os-volume_attachments => generated 194 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:07:12.026076 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-4236d6f6-229d-477c-844a-32c9e1876675 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:12.041929 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-4236d6f6-229d-477c-844a-32c9e1876675 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:12.044705 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-4236d6f6-229d-477c-844a-32c9e1876675 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:12.046689 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-4236d6f6-229d-477c-844a-32c9e1876675 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1721 microversion: 2.20 time: 0.306620 May 26 18:07:12.047859 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 387/740] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:07:11 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1721 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:07:13.073139 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-d41d9229-1b16-4f53-ae0b-63c53161731f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:13.073853 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-d41d9229-1b16-4f53-ae0b-63c53161731f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:13.083784 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d41d9229-1b16-4f53-ae0b-63c53161731f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:13.084610 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d41d9229-1b16-4f53-ae0b-63c53161731f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:13.086349 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d41d9229-1b16-4f53-ae0b-63c53161731f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:13.087257 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d41d9229-1b16-4f53-ae0b-63c53161731f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:13.343680 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-d41d9229-1b16-4f53-ae0b-63c53161731f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:13.358639 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-d41d9229-1b16-4f53-ae0b-63c53161731f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:13.361767 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-d41d9229-1b16-4f53-ae0b-63c53161731f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:13.363394 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-d41d9229-1b16-4f53-ae0b-63c53161731f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1721 microversion: 2.20 time: 0.294575 May 26 18:07:13.364420 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 354/741] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:07:13 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1721 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:07:14.389964 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-f2cf39e1-20ba-4514-a19f-89cfebc3db3c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:14.390665 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-f2cf39e1-20ba-4514-a19f-89cfebc3db3c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:14.398321 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f2cf39e1-20ba-4514-a19f-89cfebc3db3c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:14.398783 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f2cf39e1-20ba-4514-a19f-89cfebc3db3c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:14.399589 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f2cf39e1-20ba-4514-a19f-89cfebc3db3c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:14.400051 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f2cf39e1-20ba-4514-a19f-89cfebc3db3c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:14.452696 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-33c83291-fdf8-49f5-927a-790f6096cbbb tempest-VolumesGetTestJSON-869980523 tempest-VolumesGetTestJSON-869980523-project] Action: 'create', calling method: .version_select at 0x7f3ab8b553a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-54213581", "metadata": {"Type": "work"}}} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:07:14.595715 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-f2cf39e1-20ba-4514-a19f-89cfebc3db3c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:14.607391 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-f2cf39e1-20ba-4514-a19f-89cfebc3db3c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:14.609095 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-f2cf39e1-20ba-4514-a19f-89cfebc3db3c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:14.610822 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-f2cf39e1-20ba-4514-a19f-89cfebc3db3c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1721 microversion: 2.20 time: 0.224636 May 26 18:07:14.611510 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 355/742] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:07:14 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1721 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:07:14.820643 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-33c83291-fdf8-49f5-927a-790f6096cbbb tempest-VolumesGetTestJSON-869980523 tempest-VolumesGetTestJSON-869980523-project] 10.222.0.69 "POST /compute/v2.1/os-volumes" status: 200 len: 351 microversion: 2.1 time: 0.546572 May 26 18:07:14.821298 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 388/743] 10.222.0.69 () {60 vars in 1155 bytes} [Thu May 26 18:07:14 2022] POST /compute/v2.1/os-volumes => generated 351 bytes in 548 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 26 18:07:14.833232 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-02a343df-d4ff-4aef-8598-1ea715686927 tempest-VolumesGetTestJSON-869980523 tempest-VolumesGetTestJSON-869980523-project] Calling method '.version_select at 0x7f3ab8b2eaf0>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:14.893013 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-02a343df-d4ff-4aef-8598-1ea715686927 tempest-VolumesGetTestJSON-869980523 tempest-VolumesGetTestJSON-869980523-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/0a16c9b2-fe23-4882-bf29-7213a57123e3" status: 200 len: 351 microversion: 2.1 time: 0.064130 May 26 18:07:14.893706 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 356/744] 10.222.0.69 () {58 vars in 1244 bytes} [Thu May 26 18:07:14 2022] GET /compute/v2.1/os-volumes/0a16c9b2-fe23-4882-bf29-7213a57123e3 => generated 351 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:07:15.631095 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-898438b8-c191-4f79-a985-bc87fefb0a89 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:15.631849 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-898438b8-c191-4f79-a985-bc87fefb0a89 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:15.639119 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-898438b8-c191-4f79-a985-bc87fefb0a89 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:15.639572 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-898438b8-c191-4f79-a985-bc87fefb0a89 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:15.640420 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-898438b8-c191-4f79-a985-bc87fefb0a89 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:15.640857 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-898438b8-c191-4f79-a985-bc87fefb0a89 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:15.786322 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-898438b8-c191-4f79-a985-bc87fefb0a89 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:15.796166 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-898438b8-c191-4f79-a985-bc87fefb0a89 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:15.797873 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-898438b8-c191-4f79-a985-bc87fefb0a89 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:15.799140 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-898438b8-c191-4f79-a985-bc87fefb0a89 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1721 microversion: 2.20 time: 0.172859 May 26 18:07:15.799730 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 389/745] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:07:15 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:07:15.907075 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-8bfb0324-3390-4e51-b98b-eee4a1c19e3d tempest-VolumesGetTestJSON-869980523 tempest-VolumesGetTestJSON-869980523-project] Calling method '.version_select at 0x7f3ab8b518b0>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:15.958631 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-8bfb0324-3390-4e51-b98b-eee4a1c19e3d tempest-VolumesGetTestJSON-869980523 tempest-VolumesGetTestJSON-869980523-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/0a16c9b2-fe23-4882-bf29-7213a57123e3" status: 200 len: 352 microversion: 2.1 time: 0.056249 May 26 18:07:15.959216 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 357/746] 10.222.0.69 () {58 vars in 1244 bytes} [Thu May 26 18:07:15 2022] GET /compute/v2.1/os-volumes/0a16c9b2-fe23-4882-bf29-7213a57123e3 => generated 352 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:07:15.970295 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-419133e9-cb32-44f1-9003-2269e3ea15e8 tempest-VolumesGetTestJSON-869980523 tempest-VolumesGetTestJSON-869980523-project] Calling method '.version_select at 0x7f3ab9058b80>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:16.025268 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-419133e9-cb32-44f1-9003-2269e3ea15e8 tempest-VolumesGetTestJSON-869980523 tempest-VolumesGetTestJSON-869980523-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/0a16c9b2-fe23-4882-bf29-7213a57123e3" status: 200 len: 352 microversion: 2.1 time: 0.058420 May 26 18:07:16.026310 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 390/747] 10.222.0.69 () {58 vars in 1244 bytes} [Thu May 26 18:07:15 2022] GET /compute/v2.1/os-volumes/0a16c9b2-fe23-4882-bf29-7213a57123e3 => generated 352 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:07:16.042856 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-e0b9506c-532e-47e4-860c-d65dd467e7d2 tempest-VolumesGetTestJSON-869980523 tempest-VolumesGetTestJSON-869980523-project] Calling method '.version_select at 0x7f3ab8b51820>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:16.119394 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-e0b9506c-532e-47e4-860c-d65dd467e7d2 tempest-VolumesGetTestJSON-869980523 tempest-VolumesGetTestJSON-869980523-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/0a16c9b2-fe23-4882-bf29-7213a57123e3" status: 202 len: 0 microversion: 2.1 time: 0.080272 May 26 18:07:16.120342 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 358/748] 10.222.0.69 () {58 vars in 1247 bytes} [Thu May 26 18:07:16 2022] DELETE /compute/v2.1/os-volumes/0a16c9b2-fe23-4882-bf29-7213a57123e3 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:07:16.130646 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-e26c56ad-53ee-4233-93af-36b555000ce5 tempest-VolumesGetTestJSON-869980523 tempest-VolumesGetTestJSON-869980523-project] Calling method '.version_select at 0x7f3ab8f1a670>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:16.185726 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-e26c56ad-53ee-4233-93af-36b555000ce5 tempest-VolumesGetTestJSON-869980523 tempest-VolumesGetTestJSON-869980523-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/0a16c9b2-fe23-4882-bf29-7213a57123e3" status: 200 len: 351 microversion: 2.1 time: 0.059974 May 26 18:07:16.186488 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 391/749] 10.222.0.69 () {58 vars in 1244 bytes} [Thu May 26 18:07:16 2022] GET /compute/v2.1/os-volumes/0a16c9b2-fe23-4882-bf29-7213a57123e3 => generated 351 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:07:16.820324 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-d9b31661-8bed-43bf-9d48-a42a8e8fb71c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:16.821090 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-d9b31661-8bed-43bf-9d48-a42a8e8fb71c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:16.827656 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d9b31661-8bed-43bf-9d48-a42a8e8fb71c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:16.828135 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d9b31661-8bed-43bf-9d48-a42a8e8fb71c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:16.828942 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d9b31661-8bed-43bf-9d48-a42a8e8fb71c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:16.829930 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d9b31661-8bed-43bf-9d48-a42a8e8fb71c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:16.988433 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-d9b31661-8bed-43bf-9d48-a42a8e8fb71c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:16.997555 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-d9b31661-8bed-43bf-9d48-a42a8e8fb71c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:16.999123 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-d9b31661-8bed-43bf-9d48-a42a8e8fb71c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:17.000356 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-d9b31661-8bed-43bf-9d48-a42a8e8fb71c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1721 microversion: 2.20 time: 0.184877 May 26 18:07:17.001934 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 359/750] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:07:16 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1721 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:07:17.202004 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-1e78bf13-7e5a-4a40-a6e0-98c7ae3a0197 tempest-VolumesGetTestJSON-869980523 tempest-VolumesGetTestJSON-869980523-project] Calling method '.version_select at 0x7f3ab8b27550>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:17.234587 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.wsgi [None req-1e78bf13-7e5a-4a40-a6e0-98c7ae3a0197 tempest-VolumesGetTestJSON-869980523 tempest-VolumesGetTestJSON-869980523-project] HTTP exception thrown: Volume 0a16c9b2-fe23-4882-bf29-7213a57123e3 could not be found. May 26 18:07:17.239379 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-1e78bf13-7e5a-4a40-a6e0-98c7ae3a0197 tempest-VolumesGetTestJSON-869980523 tempest-VolumesGetTestJSON-869980523-project] Request method failure captured: May 26 18:07:17.239379 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: request: GET /compute/v2.1/os-volumes/0a16c9b2-fe23-4882-bf29-7213a57123e3 HTTP/1.1 May 26 18:07:17.239379 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Accept: application/json May 26 18:07:17.239379 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Accept-Encoding: identity May 26 18:07:17.239379 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Connection: close May 26 18:07:17.239379 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Content-Length: 0 May 26 18:07:17.239379 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Content-Type: application/json May 26 18:07:17.239379 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Host: 10.222.0.69 May 26 18:07:17.239379 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Openstack-System-Scope: None May 26 18:07:17.239379 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: User-Agent: python-urllib3/1.26.9 May 26 18:07:17.239379 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Auth-Token: gAAAAABij8HSle8Zm61QVPAW0YueXJ9WZcvUfnCBt9nFiW8l-BMQj9-RUFi2RoXPaBjU62GoBGl44_IefpfZIPEjb3HPdfvkqZnywhhRBI7nYuOYJn7jwbWidRVEnfCcYFi5Z7Lbme178FkUmK38Tz1kjxOLgkJIIqpDTNbZ7lAmsFGkfFutdUY May 26 18:07:17.239379 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Domain-Id: None May 26 18:07:17.239379 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Domain-Name: None May 26 18:07:17.239379 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Identity-Status: Confirmed May 26 18:07:17.239379 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Is-Admin-Project: True May 26 18:07:17.239379 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Domain-Id: default May 26 18:07:17.239379 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Domain-Name: Default May 26 18:07:17.239379 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Id: 34372c6888af440cbd3a3637596e1975 May 26 18:07:17.239379 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Name: tempest-VolumesGetTestJSON-869980523 May 26 18:07:17.239379 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Role: member,reader May 26 18:07:17.239379 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Roles: member,reader May 26 18:07:17.241764 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/34372c6888af440cbd3a3637596e1975"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/34372c6888af440cbd3a3637596e1975"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/34372c6888af440cbd3a3637596e1975"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_34372c6888af440cbd3a3637596e1975"}]}] May 26 18:07:17.241764 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant: tempest-VolumesGetTestJSON-869980523 May 26 18:07:17.241764 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant-Id: 34372c6888af440cbd3a3637596e1975 May 26 18:07:17.241764 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant-Name: tempest-VolumesGetTestJSON-869980523 May 26 18:07:17.241764 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User: tempest-VolumesGetTestJSON-869980523-project May 26 18:07:17.241764 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Domain-Id: default May 26 18:07:17.241764 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Domain-Name: Default May 26 18:07:17.241764 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Id: 9301e3e32deb4c0581f38fb6b83c13ba May 26 18:07:17.241764 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Name: tempest-VolumesGetTestJSON-869980523-project May 26 18:07:17.241764 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: method: May 26 18:07:17.241764 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: exception: Volume 0a16c9b2-fe23-4882-bf29-7213a57123e3 could not be found. May 26 18:07:17.241764 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: action_args: {'id': '0a16c9b2-fe23-4882-bf29-7213a57123e3'} May 26 18:07:17.241764 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:07:17.243188 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:07:17.243188 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 18:07:17.243188 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 18:07:17.243188 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 18:07:17.243188 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 18:07:17.243188 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 18:07:17.243188 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 18:07:17.243188 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 18:07:17.243188 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 18:07:17.243188 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 18:07:17.243188 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 18:07:17.243188 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 18:07:17.243188 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 18:07:17.243188 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 18:07:17.243188 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 18:07:17.243188 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0a16c9b2-fe23-4882-bf29-7213a57123e3 could not be found. (HTTP 404) (Request-ID: req-27b1ff13-9431-4929-a7c8-1c0e13f29c3b) May 26 18:07:17.243188 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:07:17.243188 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:07:17.243188 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:07:17.245432 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:07:17.245432 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 18:07:17.245432 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 18:07:17.245432 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 18:07:17.245432 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 18:07:17.245432 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 18:07:17.245432 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 18:07:17.245432 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 18:07:17.245432 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 18:07:17.245432 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 18:07:17.245432 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 18:07:17.245432 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 18:07:17.245432 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 18:07:17.245432 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 18:07:17.245432 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 18:07:17.245432 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 18:07:17.245432 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 18:07:17.245432 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 18:07:17.245432 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 18:07:17.247606 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 18:07:17.247606 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 18:07:17.247606 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 18:07:17.247606 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 18:07:17.247606 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0a16c9b2-fe23-4882-bf29-7213a57123e3 could not be found. May 26 18:07:17.247606 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:07:17.247606 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:07:17.247606 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:07:17.247606 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:07:17.247606 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:07:17.247606 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:07:17.247606 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:07:17.247606 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:07:17.247606 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 18:07:17.247606 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 18:07:17.247606 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:07:17.247606 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:07:17.247606 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 18:07:17.247606 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:07:17.249646 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0a16c9b2-fe23-4882-bf29-7213a57123e3 could not be found. May 26 18:07:17.249646 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:07:17.249646 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:07:17.249646 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:07:17.249646 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:07:17.249646 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:07:17.249646 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:07:17.249646 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:07:17.249646 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:07:17.249646 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0a16c9b2-fe23-4882-bf29-7213a57123e3 could not be found. May 26 18:07:17.249646 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:07:17.249646 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-1e78bf13-7e5a-4a40-a6e0-98c7ae3a0197 tempest-VolumesGetTestJSON-869980523 tempest-VolumesGetTestJSON-869980523-project] Returning 404 to user: Volume 0a16c9b2-fe23-4882-bf29-7213a57123e3 could not be found. {{(pid=117722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:07:17.249646 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-1e78bf13-7e5a-4a40-a6e0-98c7ae3a0197 tempest-VolumesGetTestJSON-869980523 tempest-VolumesGetTestJSON-869980523-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/0a16c9b2-fe23-4882-bf29-7213a57123e3" status: 404 len: 109 microversion: 2.1 time: 0.044810 May 26 18:07:17.249646 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 392/751] 10.222.0.69 () {58 vars in 1244 bytes} [Thu May 26 18:07:17 2022] GET /compute/v2.1/os-volumes/0a16c9b2-fe23-4882-bf29-7213a57123e3 => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 18:07:18.026853 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-ff98c6fb-b2cf-49d7-b0a9-030b8fa41aa0 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:18.030127 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-ff98c6fb-b2cf-49d7-b0a9-030b8fa41aa0 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:18.049331 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ff98c6fb-b2cf-49d7-b0a9-030b8fa41aa0 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:18.050639 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ff98c6fb-b2cf-49d7-b0a9-030b8fa41aa0 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:18.052381 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ff98c6fb-b2cf-49d7-b0a9-030b8fa41aa0 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:18.053556 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ff98c6fb-b2cf-49d7-b0a9-030b8fa41aa0 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:18.059748 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:18.267785 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-ff98c6fb-b2cf-49d7-b0a9-030b8fa41aa0 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:18.286424 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-ff98c6fb-b2cf-49d7-b0a9-030b8fa41aa0 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:18.289886 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-ff98c6fb-b2cf-49d7-b0a9-030b8fa41aa0 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:18.292246 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-ff98c6fb-b2cf-49d7-b0a9-030b8fa41aa0 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1721 microversion: 2.20 time: 0.272598 May 26 18:07:18.293297 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 360/752] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:07:18 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1721 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:07:18.424282 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-ec8ee2e9-afee-44a5-87c0-44ffe51e320c tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:07:18.426800 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-ec8ee2e9-afee-44a5-87c0-44ffe51e320c tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:18.439253 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:18.444137 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ec8ee2e9-afee-44a5-87c0-44ffe51e320c tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:18.445061 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ec8ee2e9-afee-44a5-87c0-44ffe51e320c tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:18.446469 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ec8ee2e9-afee-44a5-87c0-44ffe51e320c tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:18.447290 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ec8ee2e9-afee-44a5-87c0-44ffe51e320c tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:18.486943 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.objects.instance [None req-ec8ee2e9-afee-44a5-87c0-44ffe51e320c tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lazy-loading 'flavor' on Instance uuid 8e417922-03b2-40d5-814a-4303948ed31b {{(pid=117722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:07:18.619311 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-ec8ee2e9-afee-44a5-87c0-44ffe51e320c tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "POST /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b/action" status: 202 len: 0 microversion: 2.1 time: 0.205452 May 26 18:07:18.620241 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 393/753] 10.222.0.69 () {60 vars in 1277 bytes} [Thu May 26 18:07:18 2022] POST /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:07:18.632492 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-ce642078-1b2f-4a7d-ad91-37c1fac0e872 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:18.633250 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-ce642078-1b2f-4a7d-ad91-37c1fac0e872 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:18.643804 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ce642078-1b2f-4a7d-ad91-37c1fac0e872 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:18.645698 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ce642078-1b2f-4a7d-ad91-37c1fac0e872 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:18.647207 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ce642078-1b2f-4a7d-ad91-37c1fac0e872 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:18.647962 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ce642078-1b2f-4a7d-ad91-37c1fac0e872 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:18.862844 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-ce642078-1b2f-4a7d-ad91-37c1fac0e872 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:18.877808 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-ce642078-1b2f-4a7d-ad91-37c1fac0e872 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1567 microversion: 2.1 time: 0.251667 May 26 18:07:18.878980 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 361/754] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:07:18 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1567 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:19.320800 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-a78d63f2-b547-4cc4-a3d1-2b2c75940d96 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:19.321995 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-a78d63f2-b547-4cc4-a3d1-2b2c75940d96 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:19.331888 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-a78d63f2-b547-4cc4-a3d1-2b2c75940d96 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:19.334598 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-a78d63f2-b547-4cc4-a3d1-2b2c75940d96 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:19.336500 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-a78d63f2-b547-4cc4-a3d1-2b2c75940d96 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:19.337247 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-a78d63f2-b547-4cc4-a3d1-2b2c75940d96 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:19.594513 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-a78d63f2-b547-4cc4-a3d1-2b2c75940d96 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:19.611907 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-a78d63f2-b547-4cc4-a3d1-2b2c75940d96 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:19.615647 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-a78d63f2-b547-4cc4-a3d1-2b2c75940d96 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:19.618071 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-a78d63f2-b547-4cc4-a3d1-2b2c75940d96 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1721 microversion: 2.20 time: 0.301542 May 26 18:07:19.619331 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 394/755] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:07:19 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1721 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:07:19.646647 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-608f387f-6692-4023-9fe9-aae78443c9e4 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e3132350-c40c-455d-95ec-0fd2779de97d"}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:07:19.647880 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-608f387f-6692-4023-9fe9-aae78443c9e4 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 8a2d2dde-ab10-41d4-ab33-ad703f697b84] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:19.650655 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:19.658137 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-608f387f-6692-4023-9fe9-aae78443c9e4 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:19.658137 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-608f387f-6692-4023-9fe9-aae78443c9e4 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:19.658715 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-608f387f-6692-4023-9fe9-aae78443c9e4 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:19.659366 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-608f387f-6692-4023-9fe9-aae78443c9e4 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:19.772704 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.wsgi [None req-608f387f-6692-4023-9fe9-aae78443c9e4 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] HTTP exception thrown: Invalid volume: volume e3132350-c40c-455d-95ec-0fd2779de97d is already attached to instances: 8a2d2dde-ab10-41d4-ab33-ad703f697b84 May 26 18:07:19.775573 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-608f387f-6692-4023-9fe9-aae78443c9e4 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Request method failure captured: May 26 18:07:19.775573 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: request: POST /compute/v2.1/servers/8a2d2dde-ab10-41d4-ab33-ad703f697b84/os-volume_attachments HTTP/1.1 May 26 18:07:19.775573 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Accept: application/json May 26 18:07:19.775573 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Accept-Encoding: identity May 26 18:07:19.775573 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Connection: close May 26 18:07:19.775573 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Content-Length: 74 May 26 18:07:19.775573 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Content-Type: application/json May 26 18:07:19.775573 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Host: 10.222.0.69 May 26 18:07:19.775573 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Openstack-System-Scope: None May 26 18:07:19.775573 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: User-Agent: python-urllib3/1.26.9 May 26 18:07:19.775573 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Auth-Token: gAAAAABij8DD0GGF2lSLDsyvjDvkvKuYTmd8MhBJFcuAgLQjYIxaUzVYvy2y78Ufugs1Oc4LrOO28-M4MWgXvAjDAFM656TsVGzxmhayY-bOw7ExJ5yRcG231tnUdWRr6zrbitvFAB7wzSB1IdWp2Auh8VsxEfhGR0YnizUXC6yVsCWiAksLALA May 26 18:07:19.775573 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Domain-Id: None May 26 18:07:19.775573 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Domain-Name: None May 26 18:07:19.775573 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Identity-Status: Confirmed May 26 18:07:19.775573 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Is-Admin-Project: True May 26 18:07:19.775573 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Domain-Id: default May 26 18:07:19.775573 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Domain-Name: Default May 26 18:07:19.775573 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Id: 8920d2de9dc34386bb0e770f5b51b702 May 26 18:07:19.775573 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Name: tempest-AttachVolumeNegativeTest-2031663802 May 26 18:07:19.775573 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Role: member,reader May 26 18:07:19.775573 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Roles: member,reader May 26 18:07:19.777982 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8920d2de9dc34386bb0e770f5b51b702"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8920d2de9dc34386bb0e770f5b51b702"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8920d2de9dc34386bb0e770f5b51b702"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8920d2de9dc34386bb0e770f5b51b702"}]}] May 26 18:07:19.777982 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant: tempest-AttachVolumeNegativeTest-2031663802 May 26 18:07:19.777982 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant-Id: 8920d2de9dc34386bb0e770f5b51b702 May 26 18:07:19.777982 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2031663802 May 26 18:07:19.777982 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User: tempest-AttachVolumeNegativeTest-2031663802-project May 26 18:07:19.777982 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Domain-Id: default May 26 18:07:19.777982 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Domain-Name: Default May 26 18:07:19.777982 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Id: 2691e1dc96e942b5ba4c726b72a835e9 May 26 18:07:19.777982 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Name: tempest-AttachVolumeNegativeTest-2031663802-project May 26 18:07:19.777982 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: May 26 18:07:19.777982 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: {"volumeAttachment": {"volumeId": "e3132350-c40c-455d-95ec-0fd2779de97d"}} May 26 18:07:19.777982 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: method: > May 26 18:07:19.779515 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: exception: Invalid volume: volume e3132350-c40c-455d-95ec-0fd2779de97d is already attached to instances: 8a2d2dde-ab10-41d4-ab33-ad703f697b84 May 26 18:07:19.779515 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: action_args: {'server_id': '8a2d2dde-ab10-41d4-ab33-ad703f697b84', 'body': {'volumeAttachment': {'volumeId': 'e3132350-c40c-455d-95ec-0fd2779de97d'}}} May 26 18:07:19.779515 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:07:19.779515 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:07:19.779515 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 26 18:07:19.779515 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 26 18:07:19.779515 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 18:07:19.779515 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 18:07:19.779515 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 26 18:07:19.779515 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 26 18:07:19.779515 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 26 18:07:19.779515 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 26 18:07:19.779515 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 26 18:07:19.779515 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 26 18:07:19.779515 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e3132350-c40c-455d-95ec-0fd2779de97d is already attached to instances: 8a2d2dde-ab10-41d4-ab33-ad703f697b84 May 26 18:07:19.779515 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:07:19.779515 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:07:19.779515 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:07:19.779515 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:07:19.783274 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:07:19.783274 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:07:19.783274 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:07:19.783274 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:07:19.783274 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:07:19.783274 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:07:19.783274 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 18:07:19.783274 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 18:07:19.783274 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 18:07:19.783274 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 18:07:19.783274 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 18:07:19.783274 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 18:07:19.783274 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 26 18:07:19.783274 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 26 18:07:19.783274 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e3132350-c40c-455d-95ec-0fd2779de97d is already attached to instances: 8a2d2dde-ab10-41d4-ab33-ad703f697b84 May 26 18:07:19.783274 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:07:19.783274 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:07:19.783274 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:07:19.783274 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:07:19.783274 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:07:19.792458 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:07:19.792458 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:07:19.792458 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:07:19.792458 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e3132350-c40c-455d-95ec-0fd2779de97d is already attached to instances: 8a2d2dde-ab10-41d4-ab33-ad703f697b84 May 26 18:07:19.792458 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:07:19.792458 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-608f387f-6692-4023-9fe9-aae78443c9e4 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Returning 400 to user: Invalid volume: volume e3132350-c40c-455d-95ec-0fd2779de97d is already attached to instances: 8a2d2dde-ab10-41d4-ab33-ad703f697b84 {{(pid=117723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:07:19.792458 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-608f387f-6692-4023-9fe9-aae78443c9e4 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "POST /compute/v2.1/servers/8a2d2dde-ab10-41d4-ab33-ad703f697b84/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.137058 May 26 18:07:19.792458 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 362/756] 10.222.0.69 () {60 vars in 1322 bytes} [Thu May 26 18:07:19 2022] POST /compute/v2.1/servers/8a2d2dde-ab10-41d4-ab33-ad703f697b84/os-volume_attachments => generated 174 bytes in 143 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 18:07:19.872398 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-22a0675d-02a0-4197-ae5f-2cc11556f888 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:19.873310 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-22a0675d-02a0-4197-ae5f-2cc11556f888 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 8a2d2dde-ab10-41d4-ab33-ad703f697b84] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:19.885084 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-22a0675d-02a0-4197-ae5f-2cc11556f888 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:19.885898 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-22a0675d-02a0-4197-ae5f-2cc11556f888 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:19.887378 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-22a0675d-02a0-4197-ae5f-2cc11556f888 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:19.888203 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-22a0675d-02a0-4197-ae5f-2cc11556f888 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:19.901813 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-acb94179-5d2e-434e-916e-401ac060b5d6 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:19.903480 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-acb94179-5d2e-434e-916e-401ac060b5d6 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:19.912134 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-acb94179-5d2e-434e-916e-401ac060b5d6 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:19.912602 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-acb94179-5d2e-434e-916e-401ac060b5d6 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:19.913417 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-acb94179-5d2e-434e-916e-401ac060b5d6 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:19.913856 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-acb94179-5d2e-434e-916e-401ac060b5d6 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:20.057057 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.objects.instance [None req-22a0675d-02a0-4197-ae5f-2cc11556f888 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lazy-loading 'services' on Instance uuid 8a2d2dde-ab10-41d4-ab33-ad703f697b84 {{(pid=117722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:07:20.133965 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-acb94179-5d2e-434e-916e-401ac060b5d6 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:20.167641 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-acb94179-5d2e-434e-916e-401ac060b5d6 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1567 microversion: 2.1 time: 0.271585 May 26 18:07:20.168752 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 363/757] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:07:19 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1567 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:20.178431 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-22a0675d-02a0-4197-ae5f-2cc11556f888 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "DELETE /compute/v2.1/servers/8a2d2dde-ab10-41d4-ab33-ad703f697b84/os-volume_attachments/e3132350-c40c-455d-95ec-0fd2779de97d" status: 202 len: 0 microversion: 2.1 time: 0.313340 May 26 18:07:20.180377 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 395/758] 10.222.0.69 () {58 vars in 1415 bytes} [Thu May 26 18:07:19 2022] DELETE /compute/v2.1/servers/8a2d2dde-ab10-41d4-ab33-ad703f697b84/os-volume_attachments/e3132350-c40c-455d-95ec-0fd2779de97d => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:07:20.206756 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-e6779d27-6caf-4536-837b-74b1ca597de5 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:20.208595 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-e6779d27-6caf-4536-837b-74b1ca597de5 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 8a2d2dde-ab10-41d4-ab33-ad703f697b84] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:20.221417 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e6779d27-6caf-4536-837b-74b1ca597de5 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:20.222591 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e6779d27-6caf-4536-837b-74b1ca597de5 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:20.224133 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e6779d27-6caf-4536-837b-74b1ca597de5 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:20.225393 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e6779d27-6caf-4536-837b-74b1ca597de5 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:20.275702 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-e6779d27-6caf-4536-837b-74b1ca597de5 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/8a2d2dde-ab10-41d4-ab33-ad703f697b84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081964 May 26 18:07:20.276632 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 364/759] 10.222.0.69 () {58 vars in 1301 bytes} [Thu May 26 18:07:20 2022] GET /compute/v2.1/servers/8a2d2dde-ab10-41d4-ab33-ad703f697b84/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:07:20.650416 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-42ef6a61-f20f-4c0a-92be-8cc807e6ac37 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:20.651362 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-42ef6a61-f20f-4c0a-92be-8cc807e6ac37 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:20.659340 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-42ef6a61-f20f-4c0a-92be-8cc807e6ac37 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:20.659796 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-42ef6a61-f20f-4c0a-92be-8cc807e6ac37 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:20.660647 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-42ef6a61-f20f-4c0a-92be-8cc807e6ac37 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:20.661085 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-42ef6a61-f20f-4c0a-92be-8cc807e6ac37 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:20.678249 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:20.832468 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-42ef6a61-f20f-4c0a-92be-8cc807e6ac37 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:20.841595 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-42ef6a61-f20f-4c0a-92be-8cc807e6ac37 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:20.843540 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-42ef6a61-f20f-4c0a-92be-8cc807e6ac37 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:20.846343 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-42ef6a61-f20f-4c0a-92be-8cc807e6ac37 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1721 microversion: 2.20 time: 0.201392 May 26 18:07:20.847240 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 396/760] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:07:20 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1721 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:07:21.199037 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-ac98bbd5-8635-477a-ba69-f2927d43a271 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:21.199716 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-ac98bbd5-8635-477a-ba69-f2927d43a271 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:21.208153 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ac98bbd5-8635-477a-ba69-f2927d43a271 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:21.208658 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ac98bbd5-8635-477a-ba69-f2927d43a271 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:21.209533 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ac98bbd5-8635-477a-ba69-f2927d43a271 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:21.210045 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ac98bbd5-8635-477a-ba69-f2927d43a271 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:21.291876 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-12031baf-64f2-4060-a59b-358c5e2671fa tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:21.293275 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-12031baf-64f2-4060-a59b-358c5e2671fa tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 8a2d2dde-ab10-41d4-ab33-ad703f697b84] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:21.302365 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-12031baf-64f2-4060-a59b-358c5e2671fa tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:21.303176 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-12031baf-64f2-4060-a59b-358c5e2671fa tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:21.304184 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-12031baf-64f2-4060-a59b-358c5e2671fa tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:21.304769 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-12031baf-64f2-4060-a59b-358c5e2671fa tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:21.353467 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-12031baf-64f2-4060-a59b-358c5e2671fa tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/8a2d2dde-ab10-41d4-ab33-ad703f697b84/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.068780 May 26 18:07:21.354201 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 397/761] 10.222.0.69 () {58 vars in 1301 bytes} [Thu May 26 18:07:21 2022] GET /compute/v2.1/servers/8a2d2dde-ab10-41d4-ab33-ad703f697b84/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 18:07:21.407947 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-ac98bbd5-8635-477a-ba69-f2927d43a271 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:21.420183 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-ac98bbd5-8635-477a-ba69-f2927d43a271 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1567 microversion: 2.1 time: 0.224783 May 26 18:07:21.421428 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 365/762] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:07:21 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1567 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:21.435292 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-fc79ff10-56c3-4c8d-a396-74e8cbffe0bc tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:21.435924 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-fc79ff10-56c3-4c8d-a396-74e8cbffe0bc tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 8a2d2dde-ab10-41d4-ab33-ad703f697b84] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:21.446130 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-fc79ff10-56c3-4c8d-a396-74e8cbffe0bc tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:21.446792 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-fc79ff10-56c3-4c8d-a396-74e8cbffe0bc tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:21.448003 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-fc79ff10-56c3-4c8d-a396-74e8cbffe0bc tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:21.448728 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-fc79ff10-56c3-4c8d-a396-74e8cbffe0bc tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:21.481993 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-fc79ff10-56c3-4c8d-a396-74e8cbffe0bc tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 8a2d2dde-ab10-41d4-ab33-ad703f697b84] Going to try to terminate instance {{(pid=117722) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:07:21.592201 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-fc79ff10-56c3-4c8d-a396-74e8cbffe0bc tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "DELETE /compute/v2.1/servers/8a2d2dde-ab10-41d4-ab33-ad703f697b84" status: 204 len: 0 microversion: 2.1 time: 0.159752 May 26 18:07:21.593192 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 398/763] 10.222.0.69 () {58 vars in 1238 bytes} [Thu May 26 18:07:21 2022] DELETE /compute/v2.1/servers/8a2d2dde-ab10-41d4-ab33-ad703f697b84 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 18:07:21.602910 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-64a84a77-407c-421d-bc40-92a1f465e66f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:21.603535 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-64a84a77-407c-421d-bc40-92a1f465e66f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 8a2d2dde-ab10-41d4-ab33-ad703f697b84] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:21.610969 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-64a84a77-407c-421d-bc40-92a1f465e66f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:21.611430 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-64a84a77-407c-421d-bc40-92a1f465e66f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:21.612278 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-64a84a77-407c-421d-bc40-92a1f465e66f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:21.612726 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-64a84a77-407c-421d-bc40-92a1f465e66f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:21.797450 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-64a84a77-407c-421d-bc40-92a1f465e66f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:21.810442 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-64a84a77-407c-421d-bc40-92a1f465e66f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/8a2d2dde-ab10-41d4-ab33-ad703f697b84" status: 200 len: 1683 microversion: 2.1 time: 0.211365 May 26 18:07:21.811175 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 366/764] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:07:21 2022] GET /compute/v2.1/servers/8a2d2dde-ab10-41d4-ab33-ad703f697b84 => generated 1683 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:07:21.873920 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-3736699a-9c08-4104-9b1e-b55bf93b0e82 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:21.875367 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-3736699a-9c08-4104-9b1e-b55bf93b0e82 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:21.888954 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3736699a-9c08-4104-9b1e-b55bf93b0e82 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:21.894869 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3736699a-9c08-4104-9b1e-b55bf93b0e82 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:21.894869 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3736699a-9c08-4104-9b1e-b55bf93b0e82 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:21.894869 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3736699a-9c08-4104-9b1e-b55bf93b0e82 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:22.086092 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-3736699a-9c08-4104-9b1e-b55bf93b0e82 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:22.096208 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-3736699a-9c08-4104-9b1e-b55bf93b0e82 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:22.097844 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-3736699a-9c08-4104-9b1e-b55bf93b0e82 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:22.099084 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-3736699a-9c08-4104-9b1e-b55bf93b0e82 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1721 microversion: 2.20 time: 0.234464 May 26 18:07:22.099664 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 399/765] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:07:21 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1721 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:07:22.445917 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-459ed090-9ec0-4009-9d27-1519abcc2169 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:22.446581 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-459ed090-9ec0-4009-9d27-1519abcc2169 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:22.454360 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-459ed090-9ec0-4009-9d27-1519abcc2169 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:22.454828 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-459ed090-9ec0-4009-9d27-1519abcc2169 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:22.455656 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-459ed090-9ec0-4009-9d27-1519abcc2169 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:22.456177 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-459ed090-9ec0-4009-9d27-1519abcc2169 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:22.626952 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-459ed090-9ec0-4009-9d27-1519abcc2169 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:22.635572 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-459ed090-9ec0-4009-9d27-1519abcc2169 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1567 microversion: 2.1 time: 0.193704 May 26 18:07:22.636217 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 367/766] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:07:22 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1567 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:07:22.831108 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-53c66909-b626-4104-b54a-d19d1606294b tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:22.831717 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-53c66909-b626-4104-b54a-d19d1606294b tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 8a2d2dde-ab10-41d4-ab33-ad703f697b84] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:22.838297 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-53c66909-b626-4104-b54a-d19d1606294b tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:22.838747 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-53c66909-b626-4104-b54a-d19d1606294b tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:22.839545 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-53c66909-b626-4104-b54a-d19d1606294b tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:22.839986 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-53c66909-b626-4104-b54a-d19d1606294b tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:22.994277 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-53c66909-b626-4104-b54a-d19d1606294b tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:23.004627 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-53c66909-b626-4104-b54a-d19d1606294b tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/8a2d2dde-ab10-41d4-ab33-ad703f697b84" status: 200 len: 1683 microversion: 2.1 time: 0.176417 May 26 18:07:23.005486 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 400/767] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:07:22 2022] GET /compute/v2.1/servers/8a2d2dde-ab10-41d4-ab33-ad703f697b84 => generated 1683 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:07:23.116886 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-7e8e79aa-8b39-41bf-aaec-05bcaf42e7c8 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:23.117510 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-7e8e79aa-8b39-41bf-aaec-05bcaf42e7c8 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:23.126815 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7e8e79aa-8b39-41bf-aaec-05bcaf42e7c8 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:23.127607 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7e8e79aa-8b39-41bf-aaec-05bcaf42e7c8 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:23.128501 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7e8e79aa-8b39-41bf-aaec-05bcaf42e7c8 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:23.129298 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7e8e79aa-8b39-41bf-aaec-05bcaf42e7c8 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:23.307696 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-7e8e79aa-8b39-41bf-aaec-05bcaf42e7c8 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:23.321240 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-7e8e79aa-8b39-41bf-aaec-05bcaf42e7c8 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:23.323846 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-7e8e79aa-8b39-41bf-aaec-05bcaf42e7c8 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:23.325559 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-7e8e79aa-8b39-41bf-aaec-05bcaf42e7c8 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1721 microversion: 2.20 time: 0.212643 May 26 18:07:23.340562 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 368/768] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:07:23 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1721 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:07:23.657618 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-0bc0d991-128c-41c0-bbdd-ca3c9e7a39d5 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:23.658466 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-0bc0d991-128c-41c0-bbdd-ca3c9e7a39d5 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:23.667673 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0bc0d991-128c-41c0-bbdd-ca3c9e7a39d5 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:23.668453 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0bc0d991-128c-41c0-bbdd-ca3c9e7a39d5 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:23.669427 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0bc0d991-128c-41c0-bbdd-ca3c9e7a39d5 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:23.670022 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0bc0d991-128c-41c0-bbdd-ca3c9e7a39d5 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:23.945873 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-0bc0d991-128c-41c0-bbdd-ca3c9e7a39d5 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:23.957110 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-0bc0d991-128c-41c0-bbdd-ca3c9e7a39d5 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1567 microversion: 2.1 time: 0.305026 May 26 18:07:23.957927 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 401/769] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:07:23 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1567 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:07:24.034287 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-91d15a74-add2-4729-8a6c-0cb4378d297f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:24.035427 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-91d15a74-add2-4729-8a6c-0cb4378d297f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 8a2d2dde-ab10-41d4-ab33-ad703f697b84] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:24.049696 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-91d15a74-add2-4729-8a6c-0cb4378d297f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:24.050148 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-91d15a74-add2-4729-8a6c-0cb4378d297f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:24.051242 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-91d15a74-add2-4729-8a6c-0cb4378d297f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:24.051687 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-91d15a74-add2-4729-8a6c-0cb4378d297f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:24.176393 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-91d15a74-add2-4729-8a6c-0cb4378d297f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:24.186837 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-91d15a74-add2-4729-8a6c-0cb4378d297f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/8a2d2dde-ab10-41d4-ab33-ad703f697b84" status: 200 len: 1615 microversion: 2.1 time: 0.158917 May 26 18:07:24.205118 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 369/770] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:07:24 2022] GET /compute/v2.1/servers/8a2d2dde-ab10-41d4-ab33-ad703f697b84 => generated 1615 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:24.353839 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-c916ebd2-d311-4c8c-a5c4-cfe2e5d6c885 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:24.354723 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-c916ebd2-d311-4c8c-a5c4-cfe2e5d6c885 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:24.363512 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c916ebd2-d311-4c8c-a5c4-cfe2e5d6c885 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:24.364220 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c916ebd2-d311-4c8c-a5c4-cfe2e5d6c885 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:24.365193 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c916ebd2-d311-4c8c-a5c4-cfe2e5d6c885 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:24.365875 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c916ebd2-d311-4c8c-a5c4-cfe2e5d6c885 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:24.661778 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-3ea9458a-f3c4-407e-8cf2-1656f9de19a2 req-4628c818-7cb7-45f2-9d28-1e1f71258864 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a2d2dde-ab10-41d4-ab33-ad703f697b84", "name": "network-vif-deleted", "tag": "def34736-9172-4fd2-aaf3-a11444afd3f9"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:07:24.683982 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-3ea9458a-f3c4-407e-8cf2-1656f9de19a2 req-4628c818-7cb7-45f2-9d28-1e1f71258864 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:24.684542 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-3ea9458a-f3c4-407e-8cf2-1656f9de19a2 req-4628c818-7cb7-45f2-9d28-1e1f71258864 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:24.686007 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-c916ebd2-d311-4c8c-a5c4-cfe2e5d6c885 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:24.696365 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-c916ebd2-d311-4c8c-a5c4-cfe2e5d6c885 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:24.698449 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-c916ebd2-d311-4c8c-a5c4-cfe2e5d6c885 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:24.700082 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-c916ebd2-d311-4c8c-a5c4-cfe2e5d6c885 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1721 microversion: 2.20 time: 0.353029 May 26 18:07:24.713898 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 402/771] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:07:24 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1721 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:07:24.719055 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-3ea9458a-f3c4-407e-8cf2-1656f9de19a2 req-4628c818-7cb7-45f2-9d28-1e1f71258864 service nova] Creating event network-vif-deleted:def34736-9172-4fd2-aaf3-a11444afd3f9 for instance 8a2d2dde-ab10-41d4-ab33-ad703f697b84 on hv-cinder-83607 May 26 18:07:24.731173 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-3ea9458a-f3c4-407e-8cf2-1656f9de19a2 req-4628c818-7cb7-45f2-9d28-1e1f71258864 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082184 May 26 18:07:24.732559 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 370/772] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:07:24.979971 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-717c66de-b1b7-46eb-8102-ef9b71931716 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:24.981711 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-717c66de-b1b7-46eb-8102-ef9b71931716 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:24.997875 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-717c66de-b1b7-46eb-8102-ef9b71931716 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:24.999331 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-717c66de-b1b7-46eb-8102-ef9b71931716 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:25.010212 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-717c66de-b1b7-46eb-8102-ef9b71931716 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:25.010212 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-717c66de-b1b7-46eb-8102-ef9b71931716 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:25.224435 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-1be08c4f-b801-4133-8892-a838a484d2c7 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:25.226250 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-1be08c4f-b801-4133-8892-a838a484d2c7 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 8a2d2dde-ab10-41d4-ab33-ad703f697b84] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:25.244111 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1be08c4f-b801-4133-8892-a838a484d2c7 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:25.244111 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1be08c4f-b801-4133-8892-a838a484d2c7 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:25.245679 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1be08c4f-b801-4133-8892-a838a484d2c7 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:25.246644 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1be08c4f-b801-4133-8892-a838a484d2c7 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:25.296612 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1be08c4f-b801-4133-8892-a838a484d2c7 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:25.297618 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1be08c4f-b801-4133-8892-a838a484d2c7 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:25.298330 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.objects.instance [None req-1be08c4f-b801-4133-8892-a838a484d2c7 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lazy-loading 'fault' on Instance uuid 8a2d2dde-ab10-41d4-ab33-ad703f697b84 {{(pid=117723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:07:25.354661 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-717c66de-b1b7-46eb-8102-ef9b71931716 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:25.385456 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-717c66de-b1b7-46eb-8102-ef9b71931716 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1567 microversion: 2.1 time: 0.412545 May 26 18:07:25.386592 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 403/773] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:07:24 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1567 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:25.408581 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-1be08c4f-b801-4133-8892-a838a484d2c7 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:25.424340 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-1be08c4f-b801-4133-8892-a838a484d2c7 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/8a2d2dde-ab10-41d4-ab33-ad703f697b84" status: 200 len: 1331 microversion: 2.1 time: 0.211193 May 26 18:07:25.425595 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 371/774] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:07:25 2022] GET /compute/v2.1/servers/8a2d2dde-ab10-41d4-ab33-ad703f697b84 => generated 1331 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:07:25.722236 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-a0be7491-aefb-4935-ae01-d9b756264a48 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:25.722872 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-a0be7491-aefb-4935-ae01-d9b756264a48 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:25.730042 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-a0be7491-aefb-4935-ae01-d9b756264a48 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:25.730500 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-a0be7491-aefb-4935-ae01-d9b756264a48 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:25.731399 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-a0be7491-aefb-4935-ae01-d9b756264a48 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:25.731842 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-a0be7491-aefb-4935-ae01-d9b756264a48 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:25.936643 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-a0be7491-aefb-4935-ae01-d9b756264a48 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:25.946807 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-a0be7491-aefb-4935-ae01-d9b756264a48 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:25.948413 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-a0be7491-aefb-4935-ae01-d9b756264a48 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:25.949875 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-a0be7491-aefb-4935-ae01-d9b756264a48 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1721 microversion: 2.20 time: 0.233184 May 26 18:07:25.950629 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 404/775] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:07:25 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1721 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:07:26.405881 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-ef172870-a185-4c37-8b39-9034a63aff49 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:26.407461 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-ef172870-a185-4c37-8b39-9034a63aff49 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:26.415183 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ef172870-a185-4c37-8b39-9034a63aff49 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:26.415616 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ef172870-a185-4c37-8b39-9034a63aff49 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:26.416443 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ef172870-a185-4c37-8b39-9034a63aff49 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:26.416887 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ef172870-a185-4c37-8b39-9034a63aff49 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:26.455165 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-72e17b96-2056-4c2b-9e18-3e611ed8cf3e tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:26.456405 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-72e17b96-2056-4c2b-9e18-3e611ed8cf3e tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 8a2d2dde-ab10-41d4-ab33-ad703f697b84] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:26.468614 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-72e17b96-2056-4c2b-9e18-3e611ed8cf3e tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:26.470356 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-72e17b96-2056-4c2b-9e18-3e611ed8cf3e tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:26.471829 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-72e17b96-2056-4c2b-9e18-3e611ed8cf3e tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:26.472744 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-72e17b96-2056-4c2b-9e18-3e611ed8cf3e tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:26.498557 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.wsgi [None req-72e17b96-2056-4c2b-9e18-3e611ed8cf3e tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] HTTP exception thrown: Instance 8a2d2dde-ab10-41d4-ab33-ad703f697b84 could not be found. May 26 18:07:26.502456 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-72e17b96-2056-4c2b-9e18-3e611ed8cf3e tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Request method failure captured: May 26 18:07:26.502456 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: request: GET /compute/v2.1/servers/8a2d2dde-ab10-41d4-ab33-ad703f697b84 HTTP/1.1 May 26 18:07:26.502456 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Accept: application/json May 26 18:07:26.502456 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Accept-Encoding: identity May 26 18:07:26.502456 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Connection: close May 26 18:07:26.502456 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Content-Length: 0 May 26 18:07:26.502456 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Content-Type: application/json May 26 18:07:26.502456 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Host: 10.222.0.69 May 26 18:07:26.502456 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Openstack-System-Scope: None May 26 18:07:26.502456 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: User-Agent: python-urllib3/1.26.9 May 26 18:07:26.502456 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Auth-Token: gAAAAABij8DD0GGF2lSLDsyvjDvkvKuYTmd8MhBJFcuAgLQjYIxaUzVYvy2y78Ufugs1Oc4LrOO28-M4MWgXvAjDAFM656TsVGzxmhayY-bOw7ExJ5yRcG231tnUdWRr6zrbitvFAB7wzSB1IdWp2Auh8VsxEfhGR0YnizUXC6yVsCWiAksLALA May 26 18:07:26.502456 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Domain-Id: None May 26 18:07:26.502456 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Domain-Name: None May 26 18:07:26.502456 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Identity-Status: Confirmed May 26 18:07:26.502456 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Is-Admin-Project: True May 26 18:07:26.502456 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Domain-Id: default May 26 18:07:26.502456 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Domain-Name: Default May 26 18:07:26.502456 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Id: 8920d2de9dc34386bb0e770f5b51b702 May 26 18:07:26.502456 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Name: tempest-AttachVolumeNegativeTest-2031663802 May 26 18:07:26.502456 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Role: member,reader May 26 18:07:26.502456 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Roles: member,reader May 26 18:07:26.505238 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8920d2de9dc34386bb0e770f5b51b702"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8920d2de9dc34386bb0e770f5b51b702"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8920d2de9dc34386bb0e770f5b51b702"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8920d2de9dc34386bb0e770f5b51b702"}]}] May 26 18:07:26.505238 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant: tempest-AttachVolumeNegativeTest-2031663802 May 26 18:07:26.505238 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant-Id: 8920d2de9dc34386bb0e770f5b51b702 May 26 18:07:26.505238 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2031663802 May 26 18:07:26.505238 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User: tempest-AttachVolumeNegativeTest-2031663802-project May 26 18:07:26.505238 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Domain-Id: default May 26 18:07:26.505238 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Domain-Name: Default May 26 18:07:26.505238 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Id: 2691e1dc96e942b5ba4c726b72a835e9 May 26 18:07:26.505238 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Name: tempest-AttachVolumeNegativeTest-2031663802-project May 26 18:07:26.505238 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: method: > May 26 18:07:26.505238 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: exception: Instance 8a2d2dde-ab10-41d4-ab33-ad703f697b84 could not be found. May 26 18:07:26.505238 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: action_args: {'id': '8a2d2dde-ab10-41d4-ab33-ad703f697b84'} May 26 18:07:26.507739 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:07:26.507739 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:07:26.507739 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:07:26.507739 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:07:26.507739 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:07:26.507739 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:07:26.507739 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:07:26.507739 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:07:26.507739 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:07:26.507739 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:07:26.507739 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a2d2dde-ab10-41d4-ab33-ad703f697b84 could not be found. May 26 18:07:26.507739 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:07:26.507739 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:07:26.507739 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:07:26.507739 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:07:26.507739 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:07:26.507739 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:07:26.507739 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:07:26.507739 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:07:26.507739 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:07:26.509301 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:07:26.509301 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:07:26.509301 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:07:26.509301 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:07:26.509301 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:07:26.509301 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:07:26.509301 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:07:26.509301 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a2d2dde-ab10-41d4-ab33-ad703f697b84 could not be found. May 26 18:07:26.509301 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:07:26.509301 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:07:26.509301 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:07:26.509301 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:07:26.509301 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:07:26.509301 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:07:26.509301 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:07:26.509301 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:07:26.509301 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a2d2dde-ab10-41d4-ab33-ad703f697b84 could not be found. May 26 18:07:26.509301 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:07:26.510577 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-72e17b96-2056-4c2b-9e18-3e611ed8cf3e tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Returning 404 to user: Instance 8a2d2dde-ab10-41d4-ab33-ad703f697b84 could not be found. {{(pid=117722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:07:26.510577 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-72e17b96-2056-4c2b-9e18-3e611ed8cf3e tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/8a2d2dde-ab10-41d4-ab33-ad703f697b84" status: 404 len: 111 microversion: 2.1 time: 0.057408 May 26 18:07:26.510577 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 405/776] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:07:26 2022] GET /compute/v2.1/servers/8a2d2dde-ab10-41d4-ab33-ad703f697b84 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 18:07:26.521451 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-575d921d-c45f-4d06-bf56-96388d8f7df7 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '.version_select at 0x7f3ab8ca0dc0>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:26.554608 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-575d921d-c45f-4d06-bf56-96388d8f7df7 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-525900821" status: 202 len: 0 microversion: 2.1 time: 0.040799 May 26 18:07:26.555722 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 406/777] 10.222.0.69 () {58 vars in 1217 bytes} [Thu May 26 18:07:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-525900821 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 18:07:26.575609 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-ef172870-a185-4c37-8b39-9034a63aff49 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:26.585188 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-ef172870-a185-4c37-8b39-9034a63aff49 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1567 microversion: 2.1 time: 0.183552 May 26 18:07:26.585789 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 372/778] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:07:26 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1567 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:26.970275 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-bbd6c087-6d04-4feb-b1e5-0182142befb9 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:26.971149 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-bbd6c087-6d04-4feb-b1e5-0182142befb9 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:26.980060 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-bbd6c087-6d04-4feb-b1e5-0182142befb9 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:26.980603 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-bbd6c087-6d04-4feb-b1e5-0182142befb9 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:26.981439 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-bbd6c087-6d04-4feb-b1e5-0182142befb9 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:26.981888 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-bbd6c087-6d04-4feb-b1e5-0182142befb9 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:27.174299 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-bbd6c087-6d04-4feb-b1e5-0182142befb9 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:27.186067 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-bbd6c087-6d04-4feb-b1e5-0182142befb9 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:27.189102 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-bbd6c087-6d04-4feb-b1e5-0182142befb9 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:27.190692 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-bbd6c087-6d04-4feb-b1e5-0182142befb9 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1721 microversion: 2.20 time: 0.224851 May 26 18:07:27.191758 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 407/779] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:07:26 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1721 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:07:27.285164 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-26b7e0c1-ff40-42b6-960b-924ed064e454 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:27.286044 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-26b7e0c1-ff40-42b6-960b-924ed064e454 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: 00f290f6-5aaa-4234-ac0b-094f19c94959] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:27.296370 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-26b7e0c1-ff40-42b6-960b-924ed064e454 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:27.297027 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-26b7e0c1-ff40-42b6-960b-924ed064e454 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:27.298778 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-26b7e0c1-ff40-42b6-960b-924ed064e454 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:27.299479 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-26b7e0c1-ff40-42b6-960b-924ed064e454 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:27.342001 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-26b7e0c1-ff40-42b6-960b-924ed064e454 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959/ips" status: 200 len: 145 microversion: 2.1 time: 0.063449 May 26 18:07:27.342832 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 373/780] 10.222.0.69 () {58 vars in 1247 bytes} [Thu May 26 18:07:27 2022] GET /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959/ips => generated 145 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:07:27.419298 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-7e36e2d6-3c3d-4f07-89ac-c72d243f4343 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Action: 'create', calling method: .version_select at 0x7f3ab8ca0b80>, body: {"keypair": {"name": "tempest-keypair-538880582", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCtkctbTL/Ophwq7+9S8mj8Eyqq7XApjzmg87hBo1wDXJnoSFBYgONmWGYw6NOzFWx667L1JMd4eCWtksBoFps+Fv4znUPsLCGfa/FBxsuHji6GhS9DhWniwezB1YnkNYw=="}} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:07:27.449632 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.quota [None req-7e36e2d6-3c3d-4f07-89ac-c72d243f4343 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Getting quotas for project 8920d2de9dc34386bb0e770f5b51b702. Resources: {'key_pairs'} {{(pid=117722) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:07:27.455566 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.quota [None req-7e36e2d6-3c3d-4f07-89ac-c72d243f4343 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Getting quotas for user 2691e1dc96e942b5ba4c726b72a835e9 and project 8920d2de9dc34386bb0e770f5b51b702. Resources: {'key_pairs'} {{(pid=117722) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:07:27.490177 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-7e36e2d6-3c3d-4f07-89ac-c72d243f4343 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.075455 May 26 18:07:27.491184 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 408/781] 10.222.0.69 () {60 vars in 1158 bytes} [Thu May 26 18:07:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:07:27.611896 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-1f20c3f1-dc5a-46a0-9102-8bb5cfd62d7b tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:27.612651 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-1f20c3f1-dc5a-46a0-9102-8bb5cfd62d7b tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:27.619973 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1f20c3f1-dc5a-46a0-9102-8bb5cfd62d7b tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:27.620459 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1f20c3f1-dc5a-46a0-9102-8bb5cfd62d7b tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:27.621489 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1f20c3f1-dc5a-46a0-9102-8bb5cfd62d7b tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:27.622105 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1f20c3f1-dc5a-46a0-9102-8bb5cfd62d7b tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:27.894628 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-1f20c3f1-dc5a-46a0-9102-8bb5cfd62d7b tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:27.905243 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-1f20c3f1-dc5a-46a0-9102-8bb5cfd62d7b tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1567 microversion: 2.1 time: 0.297980 May 26 18:07:27.915178 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 374/782] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:07:27 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1567 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:28.221005 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-93d760d0-77c1-4454-852d-aa5bef4d8639 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:28.222970 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-93d760d0-77c1-4454-852d-aa5bef4d8639 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:28.236860 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-93d760d0-77c1-4454-852d-aa5bef4d8639 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:28.237304 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-93d760d0-77c1-4454-852d-aa5bef4d8639 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:28.239759 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-93d760d0-77c1-4454-852d-aa5bef4d8639 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:28.240440 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-93d760d0-77c1-4454-852d-aa5bef4d8639 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:28.437284 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-93d760d0-77c1-4454-852d-aa5bef4d8639 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:28.452896 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-93d760d0-77c1-4454-852d-aa5bef4d8639 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:28.456084 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-93d760d0-77c1-4454-852d-aa5bef4d8639 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:28.458275 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-93d760d0-77c1-4454-852d-aa5bef4d8639 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1721 microversion: 2.20 time: 0.249557 May 26 18:07:28.459331 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 409/783] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:07:28 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1721 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:07:28.904001 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-95995dcd-0421-49c2-87aa-23483b5ab0f7 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b55fd94d-edca-46cb-9398-436c314ea4fd"}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:07:28.906263 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-95995dcd-0421-49c2-87aa-23483b5ab0f7 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: 00f290f6-5aaa-4234-ac0b-094f19c94959] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:28.921085 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-95995dcd-0421-49c2-87aa-23483b5ab0f7 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:28.922381 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-95995dcd-0421-49c2-87aa-23483b5ab0f7 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:28.924406 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-95995dcd-0421-49c2-87aa-23483b5ab0f7 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:28.925515 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-ce100440-345d-4f2d-9245-d9b93661f72c tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:28.925948 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-95995dcd-0421-49c2-87aa-23483b5ab0f7 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:28.927138 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-ce100440-345d-4f2d-9245-d9b93661f72c tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:28.937243 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ce100440-345d-4f2d-9245-d9b93661f72c tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:28.938569 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ce100440-345d-4f2d-9245-d9b93661f72c tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:28.939931 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ce100440-345d-4f2d-9245-d9b93661f72c tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:28.940787 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ce100440-345d-4f2d-9245-d9b93661f72c tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:29.244372 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-ce100440-345d-4f2d-9245-d9b93661f72c tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:29.255323 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-ce100440-345d-4f2d-9245-d9b93661f72c tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1567 microversion: 2.1 time: 0.335724 May 26 18:07:29.269153 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 410/784] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:07:28 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1567 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:29.337705 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-95995dcd-0421-49c2-87aa-23483b5ab0f7 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "POST /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.443049 May 26 18:07:29.346169 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 375/785] 10.222.0.69 () {60 vars in 1322 bytes} [Thu May 26 18:07:28 2022] POST /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959/os-volume_attachments => generated 194 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:07:29.492308 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-cd718776-2beb-457f-b2db-50e9ab2e05b6 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:29.493019 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-cd718776-2beb-457f-b2db-50e9ab2e05b6 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:29.505711 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-cd718776-2beb-457f-b2db-50e9ab2e05b6 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:29.506711 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-cd718776-2beb-457f-b2db-50e9ab2e05b6 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:29.508355 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-cd718776-2beb-457f-b2db-50e9ab2e05b6 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:29.509284 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-cd718776-2beb-457f-b2db-50e9ab2e05b6 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:29.691215 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-4d67ce28-920e-48c6-b98f-7bc10261464a tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-574504693", "imageRef": "16351c96-cb02-4711-99d5-fd4d80e8a846", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "481c535b-a9e7-4c84-8151-52762a8d6376"}], "security_groups": [{"name": "tempest-securitygroup--1362317384"}], "key_name": "tempest-keypair-538880582", "user_data": "}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:07:29.835286 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-cd718776-2beb-457f-b2db-50e9ab2e05b6 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:29.862120 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-cd718776-2beb-457f-b2db-50e9ab2e05b6 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:29.863195 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.network.neutron [None req-4d67ce28-920e-48c6-b98f-7bc10261464a tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] validate_networks() for [('481c535b-a9e7-4c84-8151-52762a8d6376', None, None, None, None, None)] {{(pid=117723) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:07:29.865856 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-cd718776-2beb-457f-b2db-50e9ab2e05b6 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:29.868852 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-cd718776-2beb-457f-b2db-50e9ab2e05b6 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1721 microversion: 2.20 time: 0.380555 May 26 18:07:29.869640 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 411/786] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:07:29 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1721 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:07:30.278643 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-6f8fd69f-0379-4c7e-905b-61222c564994 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:30.280205 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-6f8fd69f-0379-4c7e-905b-61222c564994 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:30.293273 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-6f8fd69f-0379-4c7e-905b-61222c564994 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:30.294451 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-6f8fd69f-0379-4c7e-905b-61222c564994 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:30.296318 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-6f8fd69f-0379-4c7e-905b-61222c564994 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:30.298704 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-6f8fd69f-0379-4c7e-905b-61222c564994 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:30.556678 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-6f8fd69f-0379-4c7e-905b-61222c564994 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:30.570798 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-6f8fd69f-0379-4c7e-905b-61222c564994 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1567 microversion: 2.1 time: 0.299957 May 26 18:07:30.572131 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 412/787] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:07:30 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1567 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:30.843487 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-4d67ce28-920e-48c6-b98f-7bc10261464a tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Flavor limits 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:07:30.844410 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-4d67ce28-920e-48c6-b98f-7bc10261464a tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Image limits 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:07:30.845032 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-4d67ce28-920e-48c6-b98f-7bc10261464a tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Flavor pref 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:07:30.845458 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-4d67ce28-920e-48c6-b98f-7bc10261464a tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Image pref 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:07:30.846096 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-4d67ce28-920e-48c6-b98f-7bc10261464a tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:07:30.857640 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4d67ce28-920e-48c6-b98f-7bc10261464a tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:30.858092 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4d67ce28-920e-48c6-b98f-7bc10261464a tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:30.858920 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4d67ce28-920e-48c6-b98f-7bc10261464a tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:30.859363 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4d67ce28-920e-48c6-b98f-7bc10261464a tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:30.868538 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:30.884293 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-4d67ce28-920e-48c6-b98f-7bc10261464a tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Getting quotas for project 8920d2de9dc34386bb0e770f5b51b702. Resources: {'instances', 'ram', 'cores'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:07:30.888997 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-56bec21f-d927-45df-a482-355a8a4e79f1 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:30.889581 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-4d67ce28-920e-48c6-b98f-7bc10261464a tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Getting quotas for user 2691e1dc96e942b5ba4c726b72a835e9 and project 8920d2de9dc34386bb0e770f5b51b702. Resources: {'instances', 'ram', 'cores'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:07:30.889731 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-56bec21f-d927-45df-a482-355a8a4e79f1 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:30.897020 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-56bec21f-d927-45df-a482-355a8a4e79f1 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:30.897633 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-56bec21f-d927-45df-a482-355a8a4e79f1 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:30.898527 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-56bec21f-d927-45df-a482-355a8a4e79f1 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:30.899106 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-56bec21f-d927-45df-a482-355a8a4e79f1 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:30.903567 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-4d67ce28-920e-48c6-b98f-7bc10261464a tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Going to run 1 instances... {{(pid=117723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:07:30.906174 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-4d67ce28-920e-48c6-b98f-7bc10261464a tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 99ba7c81-2ccc-489b-b4d7-166ea0d3772f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='16351c96-cb02-4711-99d5-fd4d80e8a846',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:07:30.959730 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-4d67ce28-920e-48c6-b98f-7bc10261464a tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.273299 May 26 18:07:30.960887 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 376/788] 10.222.0.69 () {60 vars in 1146 bytes} [Thu May 26 18:07:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 1275 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 26 18:07:30.974960 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-340e75d0-963b-4644-9684-e7361a8196c5 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:30.975738 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-340e75d0-963b-4644-9684-e7361a8196c5 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 99ba7c81-2ccc-489b-b4d7-166ea0d3772f] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:31.063501 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-340e75d0-963b-4644-9684-e7361a8196c5 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:31.076562 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-340e75d0-963b-4644-9684-e7361a8196c5 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/99ba7c81-2ccc-489b-b4d7-166ea0d3772f" status: 200 len: 1240 microversion: 2.1 time: 0.106309 May 26 18:07:31.077626 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 377/789] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:07:30 2022] GET /compute/v2.1/servers/99ba7c81-2ccc-489b-b4d7-166ea0d3772f => generated 1240 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:31.091416 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-56bec21f-d927-45df-a482-355a8a4e79f1 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:31.096364 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:31.112114 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-56bec21f-d927-45df-a482-355a8a4e79f1 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:31.115620 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-56bec21f-d927-45df-a482-355a8a4e79f1 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:31.118039 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-56bec21f-d927-45df-a482-355a8a4e79f1 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1721 microversion: 2.20 time: 0.232716 May 26 18:07:31.119085 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 413/790] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:07:30 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1721 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:07:31.600772 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-e8006615-924d-459b-b416-0761a3a6b93a tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:31.601615 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-e8006615-924d-459b-b416-0761a3a6b93a tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:31.608565 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e8006615-924d-459b-b416-0761a3a6b93a tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:31.609020 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e8006615-924d-459b-b416-0761a3a6b93a tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:31.610674 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e8006615-924d-459b-b416-0761a3a6b93a tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:31.610674 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e8006615-924d-459b-b416-0761a3a6b93a tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:31.881497 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-e8006615-924d-459b-b416-0761a3a6b93a tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:31.892685 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-e8006615-924d-459b-b416-0761a3a6b93a tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1567 microversion: 2.1 time: 0.295824 May 26 18:07:31.893898 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 378/791] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:07:31 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1567 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:32.102770 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-9f78794e-de9f-46b2-8290-e8a95b3a8044 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:32.103578 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-9f78794e-de9f-46b2-8290-e8a95b3a8044 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 99ba7c81-2ccc-489b-b4d7-166ea0d3772f] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:32.117203 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-9f78794e-de9f-46b2-8290-e8a95b3a8044 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:32.117714 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-9f78794e-de9f-46b2-8290-e8a95b3a8044 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:32.118547 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-9f78794e-de9f-46b2-8290-e8a95b3a8044 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:32.119002 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-9f78794e-de9f-46b2-8290-e8a95b3a8044 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:32.149781 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-8f4179c8-8101-4488-b603-1a4cf76cadaf tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:32.150891 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-8f4179c8-8101-4488-b603-1a4cf76cadaf tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:32.161962 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8f4179c8-8101-4488-b603-1a4cf76cadaf tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:32.162613 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8f4179c8-8101-4488-b603-1a4cf76cadaf tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:32.163642 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8f4179c8-8101-4488-b603-1a4cf76cadaf tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:32.164302 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8f4179c8-8101-4488-b603-1a4cf76cadaf tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:32.201321 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-9f78794e-de9f-46b2-8290-e8a95b3a8044 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:32.210544 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-9f78794e-de9f-46b2-8290-e8a95b3a8044 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/99ba7c81-2ccc-489b-b4d7-166ea0d3772f" status: 200 len: 1292 microversion: 2.1 time: 0.114252 May 26 18:07:32.211152 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 414/792] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:07:32 2022] GET /compute/v2.1/servers/99ba7c81-2ccc-489b-b4d7-166ea0d3772f => generated 1292 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:32.341288 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-8f4179c8-8101-4488-b603-1a4cf76cadaf tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:32.350668 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-8f4179c8-8101-4488-b603-1a4cf76cadaf tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:32.352303 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-8f4179c8-8101-4488-b603-1a4cf76cadaf tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:32.353567 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-8f4179c8-8101-4488-b603-1a4cf76cadaf tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1742 microversion: 2.20 time: 0.211101 May 26 18:07:32.354228 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 379/793] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:07:32 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1742 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:07:32.926369 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-0ec274bc-c320-4860-9445-fc6f85283cbf tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:32.933228 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-0ec274bc-c320-4860-9445-fc6f85283cbf tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:32.951014 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0ec274bc-c320-4860-9445-fc6f85283cbf tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:32.952669 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0ec274bc-c320-4860-9445-fc6f85283cbf tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:32.955509 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0ec274bc-c320-4860-9445-fc6f85283cbf tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:32.957201 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0ec274bc-c320-4860-9445-fc6f85283cbf tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:33.234077 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-bf36be06-fb67-4385-9489-f3a5e455700f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:33.236901 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-bf36be06-fb67-4385-9489-f3a5e455700f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 99ba7c81-2ccc-489b-b4d7-166ea0d3772f] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:33.249199 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-bf36be06-fb67-4385-9489-f3a5e455700f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:33.250736 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-bf36be06-fb67-4385-9489-f3a5e455700f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:33.252344 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-bf36be06-fb67-4385-9489-f3a5e455700f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:33.253173 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-bf36be06-fb67-4385-9489-f3a5e455700f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:33.268626 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-0ec274bc-c320-4860-9445-fc6f85283cbf tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:33.284727 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-0ec274bc-c320-4860-9445-fc6f85283cbf tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1508 microversion: 2.1 time: 0.375453 May 26 18:07:33.286311 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 415/794] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:07:32 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1508 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:33.314302 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-b51b3d87-c753-40df-bb12-464d71212455 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:07:33.315878 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-b51b3d87-c753-40df-bb12-464d71212455 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:33.327428 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b51b3d87-c753-40df-bb12-464d71212455 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:33.329094 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b51b3d87-c753-40df-bb12-464d71212455 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:33.330713 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b51b3d87-c753-40df-bb12-464d71212455 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:33.331678 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b51b3d87-c753-40df-bb12-464d71212455 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:33.367543 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-bf36be06-fb67-4385-9489-f3a5e455700f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:33.379510 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-bf36be06-fb67-4385-9489-f3a5e455700f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/99ba7c81-2ccc-489b-b4d7-166ea0d3772f" status: 200 len: 1298 microversion: 2.1 time: 0.153375 May 26 18:07:33.380938 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 380/795] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:07:33 2022] GET /compute/v2.1/servers/99ba7c81-2ccc-489b-b4d7-166ea0d3772f => generated 1298 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:33.386513 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-05cdece7-566e-484a-8d07-d4becabcd2d5 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:33.387488 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-05cdece7-566e-484a-8d07-d4becabcd2d5 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:33.397565 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-05cdece7-566e-484a-8d07-d4becabcd2d5 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:33.398587 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-05cdece7-566e-484a-8d07-d4becabcd2d5 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:33.399631 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-05cdece7-566e-484a-8d07-d4becabcd2d5 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:33.400175 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-05cdece7-566e-484a-8d07-d4becabcd2d5 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:33.554881 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-b51b3d87-c753-40df-bb12-464d71212455 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "POST /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b/action" status: 202 len: 0 microversion: 2.1 time: 0.249244 May 26 18:07:33.559821 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 416/796] 10.222.0.69 () {60 vars in 1277 bytes} [Thu May 26 18:07:33 2022] POST /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 18:07:33.566170 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-ce0119ce-f769-4228-8842-aa7061e4d1e2 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:33.566799 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-ce0119ce-f769-4228-8842-aa7061e4d1e2 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:33.576538 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ce0119ce-f769-4228-8842-aa7061e4d1e2 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:33.577001 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ce0119ce-f769-4228-8842-aa7061e4d1e2 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:33.577831 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ce0119ce-f769-4228-8842-aa7061e4d1e2 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:33.578555 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ce0119ce-f769-4228-8842-aa7061e4d1e2 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:33.857147 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-05cdece7-566e-484a-8d07-d4becabcd2d5 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:33.880623 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-05cdece7-566e-484a-8d07-d4becabcd2d5 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:33.884501 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-05cdece7-566e-484a-8d07-d4becabcd2d5 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:33.892256 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-05cdece7-566e-484a-8d07-d4becabcd2d5 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1742 microversion: 2.20 time: 0.504811 May 26 18:07:33.894131 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 381/797] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:07:33 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1742 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:07:33.931687 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-ce0119ce-f769-4228-8842-aa7061e4d1e2 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:33.959796 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-ce0119ce-f769-4228-8842-aa7061e4d1e2 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1516 microversion: 2.1 time: 0.398327 May 26 18:07:33.961815 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 417/798] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:07:33 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1516 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:34.412342 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-c862206b-3e54-4d30-bd39-dc03af2ec6cd tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:34.413588 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-c862206b-3e54-4d30-bd39-dc03af2ec6cd tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 99ba7c81-2ccc-489b-b4d7-166ea0d3772f] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:34.438365 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c862206b-3e54-4d30-bd39-dc03af2ec6cd tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:34.441328 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c862206b-3e54-4d30-bd39-dc03af2ec6cd tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:34.447916 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c862206b-3e54-4d30-bd39-dc03af2ec6cd tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:34.449373 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c862206b-3e54-4d30-bd39-dc03af2ec6cd tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:34.876426 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-c862206b-3e54-4d30-bd39-dc03af2ec6cd tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:34.895618 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-c862206b-3e54-4d30-bd39-dc03af2ec6cd tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/99ba7c81-2ccc-489b-b4d7-166ea0d3772f" status: 200 len: 1366 microversion: 2.1 time: 0.491520 May 26 18:07:34.898404 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 382/799] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:07:34 2022] GET /compute/v2.1/servers/99ba7c81-2ccc-489b-b4d7-166ea0d3772f => generated 1366 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:34.927900 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-ab00fc97-0f28-4a4f-b434-3447f5626782 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:34.929156 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-ab00fc97-0f28-4a4f-b434-3447f5626782 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:34.942592 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ab00fc97-0f28-4a4f-b434-3447f5626782 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:34.943388 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ab00fc97-0f28-4a4f-b434-3447f5626782 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:34.945136 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ab00fc97-0f28-4a4f-b434-3447f5626782 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:34.946311 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ab00fc97-0f28-4a4f-b434-3447f5626782 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:34.997291 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-9ea4ed8d-01a6-4da2-8c68-735be25e4965 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:34.998457 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-9ea4ed8d-01a6-4da2-8c68-735be25e4965 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:35.026113 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9ea4ed8d-01a6-4da2-8c68-735be25e4965 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:35.026851 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9ea4ed8d-01a6-4da2-8c68-735be25e4965 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:35.028662 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9ea4ed8d-01a6-4da2-8c68-735be25e4965 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:35.035233 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9ea4ed8d-01a6-4da2-8c68-735be25e4965 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:35.517129 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-9ea4ed8d-01a6-4da2-8c68-735be25e4965 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:35.540961 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-9ea4ed8d-01a6-4da2-8c68-735be25e4965 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1516 microversion: 2.1 time: 0.549077 May 26 18:07:35.541914 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 383/800] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:07:34 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1516 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:35.772356 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-ab00fc97-0f28-4a4f-b434-3447f5626782 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:35.813871 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-ab00fc97-0f28-4a4f-b434-3447f5626782 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:35.816927 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-ab00fc97-0f28-4a4f-b434-3447f5626782 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:35.818547 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-ab00fc97-0f28-4a4f-b434-3447f5626782 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1737 microversion: 2.20 time: 0.904206 May 26 18:07:35.833520 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 418/801] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:07:34 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1737 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:07:35.933808 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-a65b79b0-c46a-4796-8be4-4610516beee5 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:35.935499 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-a65b79b0-c46a-4796-8be4-4610516beee5 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 99ba7c81-2ccc-489b-b4d7-166ea0d3772f] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:35.977535 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-a65b79b0-c46a-4796-8be4-4610516beee5 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:35.978339 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-a65b79b0-c46a-4796-8be4-4610516beee5 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:35.979802 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-a65b79b0-c46a-4796-8be4-4610516beee5 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:35.980641 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-a65b79b0-c46a-4796-8be4-4610516beee5 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:35.983808 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-0ef00297-dce4-4926-a322-87f41390ca10 req-2820912e-66ea-4d3f-a899-8aae28e61b12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09d62436-ae28-4b39-90d2-4530f04e4f66", "name": "network-vif-plugged", "status": "completed", "tag": "4f4d056e-de52-4943-ab5b-725a0214cc05"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:07:36.016360 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-0ef00297-dce4-4926-a322-87f41390ca10 req-2820912e-66ea-4d3f-a899-8aae28e61b12 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:36.017129 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-0ef00297-dce4-4926-a322-87f41390ca10 req-2820912e-66ea-4d3f-a899-8aae28e61b12 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:36.050107 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-0ef00297-dce4-4926-a322-87f41390ca10 req-2820912e-66ea-4d3f-a899-8aae28e61b12 service nova] Creating event network-vif-plugged:4f4d056e-de52-4943-ab5b-725a0214cc05 for instance 09d62436-ae28-4b39-90d2-4530f04e4f66 on hv-cinder-83607 May 26 18:07:36.065495 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-0ef00297-dce4-4926-a322-87f41390ca10 req-2820912e-66ea-4d3f-a899-8aae28e61b12 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.270727 May 26 18:07:36.078431 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 384/802] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:07:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:07:36.565806 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-78b0b0e3-a3fe-4285-ab77-ed568b3c2250 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:36.567064 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-78b0b0e3-a3fe-4285-ab77-ed568b3c2250 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:36.618119 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-78b0b0e3-a3fe-4285-ab77-ed568b3c2250 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:36.621059 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-78b0b0e3-a3fe-4285-ab77-ed568b3c2250 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:36.624001 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-78b0b0e3-a3fe-4285-ab77-ed568b3c2250 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:36.624962 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-78b0b0e3-a3fe-4285-ab77-ed568b3c2250 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:36.764411 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-a65b79b0-c46a-4796-8be4-4610516beee5 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:36.788784 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-a65b79b0-c46a-4796-8be4-4610516beee5 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/99ba7c81-2ccc-489b-b4d7-166ea0d3772f" status: 200 len: 1366 microversion: 2.1 time: 0.854250 May 26 18:07:36.790333 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 419/803] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:07:35 2022] GET /compute/v2.1/servers/99ba7c81-2ccc-489b-b4d7-166ea0d3772f => generated 1366 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:36.871663 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-f30939c5-35fd-4693-bf68-a8b4b86b8fb4 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:36.873740 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-f30939c5-35fd-4693-bf68-a8b4b86b8fb4 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:36.902355 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-f30939c5-35fd-4693-bf68-a8b4b86b8fb4 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:36.921033 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-f30939c5-35fd-4693-bf68-a8b4b86b8fb4 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:36.927018 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-f30939c5-35fd-4693-bf68-a8b4b86b8fb4 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:36.928214 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-f30939c5-35fd-4693-bf68-a8b4b86b8fb4 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:36.978120 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-78b0b0e3-a3fe-4285-ab77-ed568b3c2250 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:37.005545 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-78b0b0e3-a3fe-4285-ab77-ed568b3c2250 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1518 microversion: 2.1 time: 0.447024 May 26 18:07:37.014073 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 385/804] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:07:36 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1518 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:07:37.035050 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-4c0bcb73-68b7-47cc-bb10-0e507196497c req-61b508f3-ca43-4a7d-80b9-5b29928b21e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99ba7c81-2ccc-489b-b4d7-166ea0d3772f", "tag": "fdeaf409-3755-40ac-949e-78986d168e71"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:07:37.069142 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-4c0bcb73-68b7-47cc-bb10-0e507196497c req-61b508f3-ca43-4a7d-80b9-5b29928b21e3 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:37.071486 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-4c0bcb73-68b7-47cc-bb10-0e507196497c req-61b508f3-ca43-4a7d-80b9-5b29928b21e3 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:37.126210 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-4c0bcb73-68b7-47cc-bb10-0e507196497c req-61b508f3-ca43-4a7d-80b9-5b29928b21e3 service nova] Creating event network-changed:fdeaf409-3755-40ac-949e-78986d168e71 for instance 99ba7c81-2ccc-489b-b4d7-166ea0d3772f on hv-cinder-83607 May 26 18:07:37.133263 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-4c0bcb73-68b7-47cc-bb10-0e507196497c req-61b508f3-ca43-4a7d-80b9-5b29928b21e3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117553 May 26 18:07:37.134182 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 386/805] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:07:37.401137 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-f30939c5-35fd-4693-bf68-a8b4b86b8fb4 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:37.417177 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-f30939c5-35fd-4693-bf68-a8b4b86b8fb4 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:37.419044 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-f30939c5-35fd-4693-bf68-a8b4b86b8fb4 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:37.420336 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-f30939c5-35fd-4693-bf68-a8b4b86b8fb4 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1737 microversion: 2.20 time: 0.559906 May 26 18:07:37.420918 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 420/806] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:07:36 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1737 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:07:37.622815 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-2b44d113-e346-430d-90dc-e0d7556d36d0 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:37.624557 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-2b44d113-e346-430d-90dc-e0d7556d36d0 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: 00f290f6-5aaa-4234-ac0b-094f19c94959] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:37.633608 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2b44d113-e346-430d-90dc-e0d7556d36d0 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:37.634324 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2b44d113-e346-430d-90dc-e0d7556d36d0 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:37.635308 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2b44d113-e346-430d-90dc-e0d7556d36d0 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:37.635934 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2b44d113-e346-430d-90dc-e0d7556d36d0 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:37.675158 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-2b44d113-e346-430d-90dc-e0d7556d36d0 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056672 May 26 18:07:37.676115 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 387/807] 10.222.0.69 () {58 vars in 1301 bytes} [Thu May 26 18:07:37 2022] GET /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:07:37.689056 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-62884c42-bcdd-4769-b4d9-d26054b9dab3 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:37.689888 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-62884c42-bcdd-4769-b4d9-d26054b9dab3 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: 00f290f6-5aaa-4234-ac0b-094f19c94959] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:37.695902 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_cell0:SELECT=4 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:37.698379 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-62884c42-bcdd-4769-b4d9-d26054b9dab3 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:37.699152 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-62884c42-bcdd-4769-b4d9-d26054b9dab3 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:37.699961 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-62884c42-bcdd-4769-b4d9-d26054b9dab3 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:37.700606 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-62884c42-bcdd-4769-b4d9-d26054b9dab3 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:37.766522 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-62884c42-bcdd-4769-b4d9-d26054b9dab3 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959/os-volume_attachments/b55fd94d-edca-46cb-9398-436c314ea4fd" status: 200 len: 194 microversion: 2.1 time: 0.083372 May 26 18:07:37.768142 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 421/808] 10.222.0.69 () {58 vars in 1412 bytes} [Thu May 26 18:07:37 2022] GET /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959/os-volume_attachments/b55fd94d-edca-46cb-9398-436c314ea4fd => generated 194 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:07:37.806893 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-3a1a199d-2776-47aa-a20e-2a7c712a838e tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:37.807518 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-3a1a199d-2776-47aa-a20e-2a7c712a838e tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 99ba7c81-2ccc-489b-b4d7-166ea0d3772f] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:37.819464 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3a1a199d-2776-47aa-a20e-2a7c712a838e tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:37.820237 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3a1a199d-2776-47aa-a20e-2a7c712a838e tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:37.830984 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3a1a199d-2776-47aa-a20e-2a7c712a838e tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:37.835317 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3a1a199d-2776-47aa-a20e-2a7c712a838e tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:38.044363 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-3f71da8f-4a6a-42ab-a742-28da2e932d4b tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:38.050962 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-3f71da8f-4a6a-42ab-a742-28da2e932d4b tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:38.091395 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3f71da8f-4a6a-42ab-a742-28da2e932d4b tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:38.097202 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3f71da8f-4a6a-42ab-a742-28da2e932d4b tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:38.101065 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3f71da8f-4a6a-42ab-a742-28da2e932d4b tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:38.109731 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3f71da8f-4a6a-42ab-a742-28da2e932d4b tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:38.229210 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-3a1a199d-2776-47aa-a20e-2a7c712a838e tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:38.254165 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-3a1a199d-2776-47aa-a20e-2a7c712a838e tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/99ba7c81-2ccc-489b-b4d7-166ea0d3772f" status: 200 len: 1366 microversion: 2.1 time: 0.450553 May 26 18:07:38.269959 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 388/809] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:07:37 2022] GET /compute/v2.1/servers/99ba7c81-2ccc-489b-b4d7-166ea0d3772f => generated 1366 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:38.296714 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-bbf48e2a-aed8-487d-8b3b-5433c74cab24 req-90208bc0-06ab-4a38-9ddb-686f044b1dc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e417922-03b2-40d5-814a-4303948ed31b", "name": "network-vif-unplugged", "status": "completed", "tag": "971e49f3-13e4-4d71-a577-21b1d36cef54"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:07:38.320174 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-bbf48e2a-aed8-487d-8b3b-5433c74cab24 req-90208bc0-06ab-4a38-9ddb-686f044b1dc3 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:38.321377 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-bbf48e2a-aed8-487d-8b3b-5433c74cab24 req-90208bc0-06ab-4a38-9ddb-686f044b1dc3 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:38.373211 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.compute.server_external_events [req-bbf48e2a-aed8-487d-8b3b-5433c74cab24 req-90208bc0-06ab-4a38-9ddb-686f044b1dc3 service nova] Unable to find a host for instance 8e417922-03b2-40d5-814a-4303948ed31b. Dropping event network-vif-unplugged {{(pid=117723) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 26 18:07:38.376674 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-bbf48e2a-aed8-487d-8b3b-5433c74cab24 req-90208bc0-06ab-4a38-9ddb-686f044b1dc3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.096720 May 26 18:07:38.387907 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 389/810] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 115 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 26 18:07:38.458921 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-f81b6757-0b98-4b8e-9fd0-bb992b84dd5e tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:38.462243 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-f81b6757-0b98-4b8e-9fd0-bb992b84dd5e tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:38.493617 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f81b6757-0b98-4b8e-9fd0-bb992b84dd5e tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:38.493961 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f81b6757-0b98-4b8e-9fd0-bb992b84dd5e tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:38.495202 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f81b6757-0b98-4b8e-9fd0-bb992b84dd5e tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:38.495922 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f81b6757-0b98-4b8e-9fd0-bb992b84dd5e tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:38.690155 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-3f71da8f-4a6a-42ab-a742-28da2e932d4b tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:38.728521 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-3f71da8f-4a6a-42ab-a742-28da2e932d4b tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1518 microversion: 2.1 time: 0.693108 May 26 18:07:38.749173 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 422/811] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:07:38 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1518 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:07:38.896660 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-f81b6757-0b98-4b8e-9fd0-bb992b84dd5e tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:38.918729 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-f81b6757-0b98-4b8e-9fd0-bb992b84dd5e tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:38.920478 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-f81b6757-0b98-4b8e-9fd0-bb992b84dd5e tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:38.922654 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-f81b6757-0b98-4b8e-9fd0-bb992b84dd5e tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1737 microversion: 2.20 time: 0.487357 May 26 18:07:38.923324 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 390/812] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:07:38 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1737 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:07:39.288902 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-9d8c9219-ac57-4276-ac9d-0b762a34838c tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:39.289716 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-9d8c9219-ac57-4276-ac9d-0b762a34838c tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 99ba7c81-2ccc-489b-b4d7-166ea0d3772f] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:39.299352 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-9d8c9219-ac57-4276-ac9d-0b762a34838c tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:39.299960 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-9d8c9219-ac57-4276-ac9d-0b762a34838c tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:39.300898 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-9d8c9219-ac57-4276-ac9d-0b762a34838c tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:39.301458 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-9d8c9219-ac57-4276-ac9d-0b762a34838c tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:39.570071 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-0fa5d03c-7c12-4e53-a91d-0edfe62563fd tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8bffb7b5-cd31-4cde-9dff-b315558463d2"}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:07:39.571262 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-0fa5d03c-7c12-4e53-a91d-0edfe62563fd tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: 00f290f6-5aaa-4234-ac0b-094f19c94959] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:39.579943 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0fa5d03c-7c12-4e53-a91d-0edfe62563fd tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:39.582816 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0fa5d03c-7c12-4e53-a91d-0edfe62563fd tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:39.584859 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0fa5d03c-7c12-4e53-a91d-0edfe62563fd tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:39.586168 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0fa5d03c-7c12-4e53-a91d-0edfe62563fd tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:39.726371 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-9d8c9219-ac57-4276-ac9d-0b762a34838c tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:39.752043 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-9d8c9219-ac57-4276-ac9d-0b762a34838c tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/99ba7c81-2ccc-489b-b4d7-166ea0d3772f" status: 200 len: 1366 microversion: 2.1 time: 0.469218 May 26 18:07:39.753062 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 423/813] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:07:39 2022] GET /compute/v2.1/servers/99ba7c81-2ccc-489b-b4d7-166ea0d3772f => generated 1366 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:39.790641 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-56edd900-cd4e-45c1-805b-ac6c48b16abb tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:39.791815 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-56edd900-cd4e-45c1-805b-ac6c48b16abb tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:39.812843 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-56edd900-cd4e-45c1-805b-ac6c48b16abb tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:39.813702 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-56edd900-cd4e-45c1-805b-ac6c48b16abb tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:39.815173 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-56edd900-cd4e-45c1-805b-ac6c48b16abb tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:39.815994 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-56edd900-cd4e-45c1-805b-ac6c48b16abb tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:40.341567 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-56edd900-cd4e-45c1-805b-ac6c48b16abb tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:40.364970 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-56edd900-cd4e-45c1-805b-ac6c48b16abb tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1574 microversion: 2.1 time: 0.589152 May 26 18:07:40.373170 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 424/814] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:07:39 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1574 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:07:40.378640 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-0fa5d03c-7c12-4e53-a91d-0edfe62563fd tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "POST /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.811011 May 26 18:07:40.387729 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 391/815] 10.222.0.69 () {60 vars in 1322 bytes} [Thu May 26 18:07:39 2022] POST /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959/os-volume_attachments => generated 194 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:07:40.397548 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-cc0718e6-3c83-4960-91ab-703137c5fb77 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:40.398322 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-cc0718e6-3c83-4960-91ab-703137c5fb77 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:40.423203 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-cc0718e6-3c83-4960-91ab-703137c5fb77 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:40.424046 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-cc0718e6-3c83-4960-91ab-703137c5fb77 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:40.428936 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-cc0718e6-3c83-4960-91ab-703137c5fb77 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:40.429510 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-cc0718e6-3c83-4960-91ab-703137c5fb77 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:40.791857 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-15782986-a992-44dd-a31a-6f48268be184 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:40.793807 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-15782986-a992-44dd-a31a-6f48268be184 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 99ba7c81-2ccc-489b-b4d7-166ea0d3772f] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:40.806088 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-15782986-a992-44dd-a31a-6f48268be184 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:40.807157 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-15782986-a992-44dd-a31a-6f48268be184 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:40.808707 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-15782986-a992-44dd-a31a-6f48268be184 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:40.809597 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-15782986-a992-44dd-a31a-6f48268be184 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:40.836310 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-cc0718e6-3c83-4960-91ab-703137c5fb77 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:40.860390 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-cc0718e6-3c83-4960-91ab-703137c5fb77 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:40.865872 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-cc0718e6-3c83-4960-91ab-703137c5fb77 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:40.869281 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-cc0718e6-3c83-4960-91ab-703137c5fb77 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1737 microversion: 2.20 time: 0.494951 May 26 18:07:40.871730 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell0:SELECT=2 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:40.872531 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 425/816] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:07:40 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1737 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:07:41.068188 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell0:SELECT=8 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:41.270336 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-15782986-a992-44dd-a31a-6f48268be184 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:41.295462 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-15782986-a992-44dd-a31a-6f48268be184 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/99ba7c81-2ccc-489b-b4d7-166ea0d3772f" status: 200 len: 1366 microversion: 2.1 time: 0.513682 May 26 18:07:41.297190 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 392/817] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:07:40 2022] GET /compute/v2.1/servers/99ba7c81-2ccc-489b-b4d7-166ea0d3772f => generated 1366 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:41.392629 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-4f61d0ef-4c70-42ab-b4ae-f18594533efe tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:41.393626 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-4f61d0ef-4c70-42ab-b4ae-f18594533efe tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:41.408567 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-4f61d0ef-4c70-42ab-b4ae-f18594533efe tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:41.420855 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-4f61d0ef-4c70-42ab-b4ae-f18594533efe tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:41.422183 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-4f61d0ef-4c70-42ab-b4ae-f18594533efe tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:41.422825 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-4f61d0ef-4c70-42ab-b4ae-f18594533efe tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:41.768796 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-4f61d0ef-4c70-42ab-b4ae-f18594533efe tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:41.781578 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-4f61d0ef-4c70-42ab-b4ae-f18594533efe tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1574 microversion: 2.1 time: 0.392117 May 26 18:07:41.792906 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 426/818] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:07:41 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1574 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:41.923877 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-971b2098-8be9-4cb8-adc7-1ea8562cd506 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:41.926095 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-971b2098-8be9-4cb8-adc7-1ea8562cd506 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:41.944330 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-971b2098-8be9-4cb8-adc7-1ea8562cd506 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:41.945371 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-971b2098-8be9-4cb8-adc7-1ea8562cd506 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:41.947188 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-971b2098-8be9-4cb8-adc7-1ea8562cd506 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:41.948978 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-971b2098-8be9-4cb8-adc7-1ea8562cd506 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:42.267898 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-971b2098-8be9-4cb8-adc7-1ea8562cd506 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:42.278185 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-971b2098-8be9-4cb8-adc7-1ea8562cd506 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:42.281131 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-971b2098-8be9-4cb8-adc7-1ea8562cd506 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:42.283316 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-971b2098-8be9-4cb8-adc7-1ea8562cd506 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1737 microversion: 2.20 time: 0.381703 May 26 18:07:42.285509 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 393/819] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:07:41 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1737 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:07:42.326708 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-2b191abb-77fe-4c19-b6f5-250c8aef4829 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:42.328872 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-2b191abb-77fe-4c19-b6f5-250c8aef4829 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 99ba7c81-2ccc-489b-b4d7-166ea0d3772f] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:42.345063 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-2b191abb-77fe-4c19-b6f5-250c8aef4829 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:42.345867 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-2b191abb-77fe-4c19-b6f5-250c8aef4829 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:42.347605 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-2b191abb-77fe-4c19-b6f5-250c8aef4829 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:42.348333 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-2b191abb-77fe-4c19-b6f5-250c8aef4829 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:42.808714 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-b8c5acf4-93d6-4585-a19b-4933326e0cfb tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:42.813320 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-2b191abb-77fe-4c19-b6f5-250c8aef4829 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:42.814789 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-b8c5acf4-93d6-4585-a19b-4933326e0cfb tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:42.822609 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-2b191abb-77fe-4c19-b6f5-250c8aef4829 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/99ba7c81-2ccc-489b-b4d7-166ea0d3772f" status: 200 len: 1366 microversion: 2.1 time: 0.510656 May 26 18:07:42.836808 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b8c5acf4-93d6-4585-a19b-4933326e0cfb tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:42.837576 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 427/820] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:07:42 2022] GET /compute/v2.1/servers/99ba7c81-2ccc-489b-b4d7-166ea0d3772f => generated 1366 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:42.849071 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b8c5acf4-93d6-4585-a19b-4933326e0cfb tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:42.851281 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b8c5acf4-93d6-4585-a19b-4933326e0cfb tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:42.852640 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b8c5acf4-93d6-4585-a19b-4933326e0cfb tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:43.028277 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-b8c5acf4-93d6-4585-a19b-4933326e0cfb tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:43.039073 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-b8c5acf4-93d6-4585-a19b-4933326e0cfb tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1574 microversion: 2.1 time: 0.240585 May 26 18:07:43.049671 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 394/821] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:07:42 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1574 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:43.316997 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-828e4901-2051-42a3-b8e4-677ad0e9b457 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:43.317914 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-828e4901-2051-42a3-b8e4-677ad0e9b457 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:43.329302 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-828e4901-2051-42a3-b8e4-677ad0e9b457 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:43.331382 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-828e4901-2051-42a3-b8e4-677ad0e9b457 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:43.332595 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-828e4901-2051-42a3-b8e4-677ad0e9b457 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:43.333551 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-828e4901-2051-42a3-b8e4-677ad0e9b457 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:43.600381 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-828e4901-2051-42a3-b8e4-677ad0e9b457 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:43.616537 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-828e4901-2051-42a3-b8e4-677ad0e9b457 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:43.620668 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-828e4901-2051-42a3-b8e4-677ad0e9b457 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:43.623451 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-828e4901-2051-42a3-b8e4-677ad0e9b457 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1737 microversion: 2.20 time: 0.312711 May 26 18:07:43.626124 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 428/822] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:07:43 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1737 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:07:43.849320 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-250a2759-c783-4337-98af-b450efc8ba3a tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:43.850531 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-250a2759-c783-4337-98af-b450efc8ba3a tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 99ba7c81-2ccc-489b-b4d7-166ea0d3772f] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:43.874244 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [req-f1212918-bb56-4b39-a524-ec3cc5fd25c7 req-efeb9f86-3ab9-4265-ab38-baf2f0155d30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99ba7c81-2ccc-489b-b4d7-166ea0d3772f", "name": "network-vif-plugged", "status": "completed", "tag": "fdeaf409-3755-40ac-949e-78986d168e71"}]} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:07:43.886836 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-f1212918-bb56-4b39-a524-ec3cc5fd25c7 req-efeb9f86-3ab9-4265-ab38-baf2f0155d30 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:43.889994 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-f1212918-bb56-4b39-a524-ec3cc5fd25c7 req-efeb9f86-3ab9-4265-ab38-baf2f0155d30 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:43.890223 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-250a2759-c783-4337-98af-b450efc8ba3a tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:43.892304 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-250a2759-c783-4337-98af-b450efc8ba3a tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:43.894239 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-250a2759-c783-4337-98af-b450efc8ba3a tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:43.895261 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-250a2759-c783-4337-98af-b450efc8ba3a tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:43.915545 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:43.931437 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.compute.server_external_events [req-f1212918-bb56-4b39-a524-ec3cc5fd25c7 req-efeb9f86-3ab9-4265-ab38-baf2f0155d30 service nova] Creating event network-vif-plugged:fdeaf409-3755-40ac-949e-78986d168e71 for instance 99ba7c81-2ccc-489b-b4d7-166ea0d3772f on hv-cinder-83607 May 26 18:07:43.951321 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [req-f1212918-bb56-4b39-a524-ec3cc5fd25c7 req-efeb9f86-3ab9-4265-ab38-baf2f0155d30 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086728 May 26 18:07:43.951938 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 429/823] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:07:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:07:44.058719 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-d8e0eae3-01f7-4025-ba15-035047e909e8 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:44.059728 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-d8e0eae3-01f7-4025-ba15-035047e909e8 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:44.067406 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d8e0eae3-01f7-4025-ba15-035047e909e8 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:44.068292 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d8e0eae3-01f7-4025-ba15-035047e909e8 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:44.069345 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d8e0eae3-01f7-4025-ba15-035047e909e8 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:44.069998 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d8e0eae3-01f7-4025-ba15-035047e909e8 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:44.084833 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:44.304521 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-250a2759-c783-4337-98af-b450efc8ba3a tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:44.321469 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-250a2759-c783-4337-98af-b450efc8ba3a tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/99ba7c81-2ccc-489b-b4d7-166ea0d3772f" status: 200 len: 1366 microversion: 2.1 time: 0.483435 May 26 18:07:44.322409 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 395/824] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:07:43 2022] GET /compute/v2.1/servers/99ba7c81-2ccc-489b-b4d7-166ea0d3772f => generated 1366 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:44.536352 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-d8e0eae3-01f7-4025-ba15-035047e909e8 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:44.551523 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-d8e0eae3-01f7-4025-ba15-035047e909e8 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1574 microversion: 2.1 time: 0.497221 May 26 18:07:44.552442 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 430/825] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:07:44 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1574 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:44.664862 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-c3e18b7b-f574-4f44-b1e0-e848c92f4850 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:44.666132 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-c3e18b7b-f574-4f44-b1e0-e848c92f4850 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:44.678535 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c3e18b7b-f574-4f44-b1e0-e848c92f4850 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:44.679631 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c3e18b7b-f574-4f44-b1e0-e848c92f4850 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:44.681368 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c3e18b7b-f574-4f44-b1e0-e848c92f4850 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:44.682518 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c3e18b7b-f574-4f44-b1e0-e848c92f4850 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:44.987346 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-c3e18b7b-f574-4f44-b1e0-e848c92f4850 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:45.010451 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-c3e18b7b-f574-4f44-b1e0-e848c92f4850 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:45.013768 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-c3e18b7b-f574-4f44-b1e0-e848c92f4850 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:45.016617 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-c3e18b7b-f574-4f44-b1e0-e848c92f4850 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1737 microversion: 2.20 time: 0.365758 May 26 18:07:45.029487 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 396/826] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:07:44 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1737 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:07:45.355665 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-36f74624-f268-4d74-9daa-ba625365235d tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:45.356572 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-36f74624-f268-4d74-9daa-ba625365235d tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 99ba7c81-2ccc-489b-b4d7-166ea0d3772f] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:45.372334 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-36f74624-f268-4d74-9daa-ba625365235d tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:45.375120 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-36f74624-f268-4d74-9daa-ba625365235d tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:45.376998 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-36f74624-f268-4d74-9daa-ba625365235d tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:45.377620 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-36f74624-f268-4d74-9daa-ba625365235d tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:45.575675 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-d5672df9-94c2-49ec-bed8-744c82cf3ec2 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:45.580063 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-d5672df9-94c2-49ec-bed8-744c82cf3ec2 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:45.604939 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d5672df9-94c2-49ec-bed8-744c82cf3ec2 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:45.606760 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d5672df9-94c2-49ec-bed8-744c82cf3ec2 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:45.609460 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d5672df9-94c2-49ec-bed8-744c82cf3ec2 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:45.610538 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d5672df9-94c2-49ec-bed8-744c82cf3ec2 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:45.627457 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-36f74624-f268-4d74-9daa-ba625365235d tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:45.638977 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-36f74624-f268-4d74-9daa-ba625365235d tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/99ba7c81-2ccc-489b-b4d7-166ea0d3772f" status: 200 len: 1366 microversion: 2.1 time: 0.289613 May 26 18:07:45.640499 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 431/827] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:07:45 2022] GET /compute/v2.1/servers/99ba7c81-2ccc-489b-b4d7-166ea0d3772f => generated 1366 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:45.820139 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-d5672df9-94c2-49ec-bed8-744c82cf3ec2 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:45.831602 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-d5672df9-94c2-49ec-bed8-744c82cf3ec2 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1574 microversion: 2.1 time: 0.265334 May 26 18:07:45.832626 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 397/828] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:07:45 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1574 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:46.053864 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-bee867e4-dec4-4c06-b8e5-7bf14d5d89ff tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:46.055110 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-bee867e4-dec4-4c06-b8e5-7bf14d5d89ff tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:46.065855 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-bee867e4-dec4-4c06-b8e5-7bf14d5d89ff tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:46.066492 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-bee867e4-dec4-4c06-b8e5-7bf14d5d89ff tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:46.068004 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-bee867e4-dec4-4c06-b8e5-7bf14d5d89ff tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:46.068852 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-bee867e4-dec4-4c06-b8e5-7bf14d5d89ff tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:46.334058 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-bee867e4-dec4-4c06-b8e5-7bf14d5d89ff tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:46.354369 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-bee867e4-dec4-4c06-b8e5-7bf14d5d89ff tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:46.357648 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-bee867e4-dec4-4c06-b8e5-7bf14d5d89ff tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:46.366349 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-bee867e4-dec4-4c06-b8e5-7bf14d5d89ff tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1737 microversion: 2.20 time: 0.321157 May 26 18:07:46.367444 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 432/829] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:07:46 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1737 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:07:46.677512 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-fcd86919-5e2c-4c4b-b992-863c18585b64 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:46.678672 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-fcd86919-5e2c-4c4b-b992-863c18585b64 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 99ba7c81-2ccc-489b-b4d7-166ea0d3772f] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:46.699326 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fcd86919-5e2c-4c4b-b992-863c18585b64 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:46.700458 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fcd86919-5e2c-4c4b-b992-863c18585b64 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:46.702077 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fcd86919-5e2c-4c4b-b992-863c18585b64 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:46.702847 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fcd86919-5e2c-4c4b-b992-863c18585b64 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:46.868074 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-4f97cfae-2ef5-4be0-9984-f8feef61b8a7 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:46.877613 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-4f97cfae-2ef5-4be0-9984-f8feef61b8a7 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:46.895853 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:46.899133 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-4f97cfae-2ef5-4be0-9984-f8feef61b8a7 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:46.903070 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-4f97cfae-2ef5-4be0-9984-f8feef61b8a7 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:46.906213 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-fcd86919-5e2c-4c4b-b992-863c18585b64 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:46.907416 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-4f97cfae-2ef5-4be0-9984-f8feef61b8a7 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:46.909566 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-4f97cfae-2ef5-4be0-9984-f8feef61b8a7 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:46.921597 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-fcd86919-5e2c-4c4b-b992-863c18585b64 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/99ba7c81-2ccc-489b-b4d7-166ea0d3772f" status: 200 len: 1557 microversion: 2.1 time: 0.249828 May 26 18:07:46.923152 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 398/830] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:07:46 2022] GET /compute/v2.1/servers/99ba7c81-2ccc-489b-b4d7-166ea0d3772f => generated 1557 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:46.967615 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-d58389ee-c246-4885-bc9e-22baa6d4d4a8 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:46.970076 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-d58389ee-c246-4885-bc9e-22baa6d4d4a8 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 99ba7c81-2ccc-489b-b4d7-166ea0d3772f] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:46.983215 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d58389ee-c246-4885-bc9e-22baa6d4d4a8 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:46.985934 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d58389ee-c246-4885-bc9e-22baa6d4d4a8 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:46.989213 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d58389ee-c246-4885-bc9e-22baa6d4d4a8 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:46.990335 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d58389ee-c246-4885-bc9e-22baa6d4d4a8 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:47.231037 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-d58389ee-c246-4885-bc9e-22baa6d4d4a8 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/99ba7c81-2ccc-489b-b4d7-166ea0d3772f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.273228 May 26 18:07:47.232170 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 399/831] 10.222.0.69 () {58 vars in 1274 bytes} [Thu May 26 18:07:46 2022] GET /compute/v2.1/servers/99ba7c81-2ccc-489b-b4d7-166ea0d3772f/os-interface => generated 285 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:07:47.295550 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-4f97cfae-2ef5-4be0-9984-f8feef61b8a7 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:47.310267 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-4f97cfae-2ef5-4be0-9984-f8feef61b8a7 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1574 microversion: 2.1 time: 0.453616 May 26 18:07:47.311513 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 433/832] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:07:46 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1574 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:47.390718 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-8b84f5f7-8f26-4daf-b123-f663e0d99a19 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:47.392202 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-8b84f5f7-8f26-4daf-b123-f663e0d99a19 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:47.407286 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8b84f5f7-8f26-4daf-b123-f663e0d99a19 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:47.408076 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8b84f5f7-8f26-4daf-b123-f663e0d99a19 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:47.409164 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8b84f5f7-8f26-4daf-b123-f663e0d99a19 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:47.409870 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8b84f5f7-8f26-4daf-b123-f663e0d99a19 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:47.752597 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-8b84f5f7-8f26-4daf-b123-f663e0d99a19 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:47.763368 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-8b84f5f7-8f26-4daf-b123-f663e0d99a19 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:47.770366 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-8b84f5f7-8f26-4daf-b123-f663e0d99a19 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:47.771790 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-8b84f5f7-8f26-4daf-b123-f663e0d99a19 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1737 microversion: 2.20 time: 0.386837 May 26 18:07:47.784340 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 400/833] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:07:47 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1737 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:07:48.339447 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-5dff9512-8bd7-4829-9382-aaaed5e97eac tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:48.342360 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-5dff9512-8bd7-4829-9382-aaaed5e97eac tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:48.365598 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-5dff9512-8bd7-4829-9382-aaaed5e97eac tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:48.366844 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-5dff9512-8bd7-4829-9382-aaaed5e97eac tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:48.369449 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-5dff9512-8bd7-4829-9382-aaaed5e97eac tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:48.370633 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-5dff9512-8bd7-4829-9382-aaaed5e97eac tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:48.516090 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-60c0fe8e-37e7-4bff-9f54-2142cc5592a4 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:48.520949 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-60c0fe8e-37e7-4bff-9f54-2142cc5592a4 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: 00f290f6-5aaa-4234-ac0b-094f19c94959] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:48.534585 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-60c0fe8e-37e7-4bff-9f54-2142cc5592a4 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:48.536272 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-60c0fe8e-37e7-4bff-9f54-2142cc5592a4 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:48.538069 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-60c0fe8e-37e7-4bff-9f54-2142cc5592a4 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:48.539522 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-60c0fe8e-37e7-4bff-9f54-2142cc5592a4 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:48.597790 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-60c0fe8e-37e7-4bff-9f54-2142cc5592a4 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.093539 May 26 18:07:48.598642 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 401/834] 10.222.0.69 () {58 vars in 1301 bytes} [Thu May 26 18:07:48 2022] GET /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959/os-volume_attachments => generated 371 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:07:48.696699 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-5dff9512-8bd7-4829-9382-aaaed5e97eac tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:48.722621 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-5dff9512-8bd7-4829-9382-aaaed5e97eac tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1574 microversion: 2.1 time: 0.389136 May 26 18:07:48.736870 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 434/835] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:07:48 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1574 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:48.742860 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-8c2f84c5-ef66-4fe3-ba82-712c4fc724a2 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:48.742860 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-8c2f84c5-ef66-4fe3-ba82-712c4fc724a2 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: 00f290f6-5aaa-4234-ac0b-094f19c94959] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:48.743656 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:48.751326 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8c2f84c5-ef66-4fe3-ba82-712c4fc724a2 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:48.752084 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8c2f84c5-ef66-4fe3-ba82-712c4fc724a2 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:48.753354 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8c2f84c5-ef66-4fe3-ba82-712c4fc724a2 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:48.754470 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8c2f84c5-ef66-4fe3-ba82-712c4fc724a2 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:48.794923 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-13444089-59be-40da-a04d-cb6bc0021442 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:48.796581 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-13444089-59be-40da-a04d-cb6bc0021442 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:48.824242 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-13444089-59be-40da-a04d-cb6bc0021442 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:48.825192 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-8c2f84c5-ef66-4fe3-ba82-712c4fc724a2 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959/os-volume_attachments/b55fd94d-edca-46cb-9398-436c314ea4fd" status: 200 len: 194 microversion: 2.1 time: 0.088353 May 26 18:07:48.826031 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 402/836] 10.222.0.69 () {58 vars in 1412 bytes} [Thu May 26 18:07:48 2022] GET /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959/os-volume_attachments/b55fd94d-edca-46cb-9398-436c314ea4fd => generated 194 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:07:48.827851 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-13444089-59be-40da-a04d-cb6bc0021442 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:48.829092 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-13444089-59be-40da-a04d-cb6bc0021442 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:48.829759 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-13444089-59be-40da-a04d-cb6bc0021442 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:48.849663 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-340efffa-096d-47bd-88d3-a820fe46aeff tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:48.850140 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-340efffa-096d-47bd-88d3-a820fe46aeff tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: 00f290f6-5aaa-4234-ac0b-094f19c94959] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:48.866509 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-340efffa-096d-47bd-88d3-a820fe46aeff tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:48.866980 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-340efffa-096d-47bd-88d3-a820fe46aeff tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:48.867781 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-340efffa-096d-47bd-88d3-a820fe46aeff tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:48.868275 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-340efffa-096d-47bd-88d3-a820fe46aeff tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:49.105258 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.objects.instance [None req-340efffa-096d-47bd-88d3-a820fe46aeff tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lazy-loading 'services' on Instance uuid 00f290f6-5aaa-4234-ac0b-094f19c94959 {{(pid=117723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:07:49.171011 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-13444089-59be-40da-a04d-cb6bc0021442 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:49.188855 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-13444089-59be-40da-a04d-cb6bc0021442 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:49.192693 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-13444089-59be-40da-a04d-cb6bc0021442 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:49.195478 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-13444089-59be-40da-a04d-cb6bc0021442 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1737 microversion: 2.20 time: 0.407083 May 26 18:07:49.197642 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 435/837] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:07:48 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1737 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:07:49.324682 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-340efffa-096d-47bd-88d3-a820fe46aeff tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "DELETE /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959/os-volume_attachments/b55fd94d-edca-46cb-9398-436c314ea4fd" status: 202 len: 0 microversion: 2.1 time: 0.475482 May 26 18:07:49.332472 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 403/838] 10.222.0.69 () {58 vars in 1415 bytes} [Thu May 26 18:07:48 2022] DELETE /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959/os-volume_attachments/b55fd94d-edca-46cb-9398-436c314ea4fd => generated 0 bytes in 489 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 18:07:49.648318 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [req-9fdf95f3-7748-4c21-929a-30dea348947c req-3170989d-149d-4020-b4a7-d64683a10c8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99ba7c81-2ccc-489b-b4d7-166ea0d3772f", "tag": "fdeaf409-3755-40ac-949e-78986d168e71"}]} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:07:49.683792 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-9fdf95f3-7748-4c21-929a-30dea348947c req-3170989d-149d-4020-b4a7-d64683a10c8d service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:49.685258 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-9fdf95f3-7748-4c21-929a-30dea348947c req-3170989d-149d-4020-b4a7-d64683a10c8d service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:49.745947 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.compute.server_external_events [req-9fdf95f3-7748-4c21-929a-30dea348947c req-3170989d-149d-4020-b4a7-d64683a10c8d service nova] Creating event network-changed:fdeaf409-3755-40ac-949e-78986d168e71 for instance 99ba7c81-2ccc-489b-b4d7-166ea0d3772f on hv-cinder-83607 May 26 18:07:49.763086 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [req-9fdf95f3-7748-4c21-929a-30dea348947c req-3170989d-149d-4020-b4a7-d64683a10c8d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.562584 May 26 18:07:49.769030 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 436/839] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:07:49.783518 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-df5e2239-7adb-4ee9-881c-c961df4bb439 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:49.784307 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-df5e2239-7adb-4ee9-881c-c961df4bb439 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:49.819174 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-df5e2239-7adb-4ee9-881c-c961df4bb439 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:49.819643 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-df5e2239-7adb-4ee9-881c-c961df4bb439 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:49.831509 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-df5e2239-7adb-4ee9-881c-c961df4bb439 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:49.835289 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-df5e2239-7adb-4ee9-881c-c961df4bb439 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:50.236249 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-e076439a-8272-4875-b685-4ba0597860bd tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:50.246212 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-e076439a-8272-4875-b685-4ba0597860bd tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:50.267422 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e076439a-8272-4875-b685-4ba0597860bd tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:50.269153 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e076439a-8272-4875-b685-4ba0597860bd tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:50.271325 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e076439a-8272-4875-b685-4ba0597860bd tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:50.272805 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e076439a-8272-4875-b685-4ba0597860bd tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:50.347196 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-df5e2239-7adb-4ee9-881c-c961df4bb439 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:50.359878 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-df5e2239-7adb-4ee9-881c-c961df4bb439 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1574 microversion: 2.1 time: 0.597270 May 26 18:07:50.370781 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 404/840] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:07:49 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1574 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:50.719374 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-e076439a-8272-4875-b685-4ba0597860bd tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:50.734963 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-e076439a-8272-4875-b685-4ba0597860bd tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:50.737859 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-e076439a-8272-4875-b685-4ba0597860bd tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:50.742038 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-e076439a-8272-4875-b685-4ba0597860bd tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1737 microversion: 2.20 time: 0.519946 May 26 18:07:50.744727 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 437/841] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:07:50 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1737 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:07:51.390486 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-56786f42-4d23-4ec5-95bb-459164c89e33 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:51.391204 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-56786f42-4d23-4ec5-95bb-459164c89e33 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:51.400185 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-56786f42-4d23-4ec5-95bb-459164c89e33 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:51.401008 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-56786f42-4d23-4ec5-95bb-459164c89e33 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:51.402246 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-56786f42-4d23-4ec5-95bb-459164c89e33 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:51.402891 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-56786f42-4d23-4ec5-95bb-459164c89e33 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:51.761222 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-56786f42-4d23-4ec5-95bb-459164c89e33 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:51.764170 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-872f3051-ac6f-44e6-9cd8-a8adb2dd4cff tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:51.765138 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-872f3051-ac6f-44e6-9cd8-a8adb2dd4cff tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:51.782941 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-56786f42-4d23-4ec5-95bb-459164c89e33 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1574 microversion: 2.1 time: 0.406315 May 26 18:07:51.786366 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 405/842] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:07:51 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1574 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:51.788813 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-872f3051-ac6f-44e6-9cd8-a8adb2dd4cff tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:51.789281 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-872f3051-ac6f-44e6-9cd8-a8adb2dd4cff tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:51.792498 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-872f3051-ac6f-44e6-9cd8-a8adb2dd4cff tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:51.802265 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-872f3051-ac6f-44e6-9cd8-a8adb2dd4cff tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:51.821104 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-22a5ac33-09c7-4006-af58-868dec44e433 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:51.822002 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-22a5ac33-09c7-4006-af58-868dec44e433 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: 00f290f6-5aaa-4234-ac0b-094f19c94959] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:51.828924 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-22a5ac33-09c7-4006-af58-868dec44e433 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:51.830047 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-22a5ac33-09c7-4006-af58-868dec44e433 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:51.831290 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-22a5ac33-09c7-4006-af58-868dec44e433 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:51.832136 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-22a5ac33-09c7-4006-af58-868dec44e433 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:51.887046 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-22a5ac33-09c7-4006-af58-868dec44e433 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959/os-volume_attachments/8bffb7b5-cd31-4cde-9dff-b315558463d2" status: 200 len: 194 microversion: 2.1 time: 0.067329 May 26 18:07:51.893441 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 406/843] 10.222.0.69 () {58 vars in 1412 bytes} [Thu May 26 18:07:51 2022] GET /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959/os-volume_attachments/8bffb7b5-cd31-4cde-9dff-b315558463d2 => generated 194 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:07:51.898989 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-fe28dfa6-359c-4e6d-a438-33e80f169a32 req-a64d47d4-fe6c-4232-a210-f84189fda090 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e417922-03b2-40d5-814a-4303948ed31b", "name": "network-vif-plugged", "status": "completed", "tag": "971e49f3-13e4-4d71-a577-21b1d36cef54"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:07:51.910982 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-fe28dfa6-359c-4e6d-a438-33e80f169a32 req-a64d47d4-fe6c-4232-a210-f84189fda090 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:51.911894 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-fe28dfa6-359c-4e6d-a438-33e80f169a32 req-a64d47d4-fe6c-4232-a210-f84189fda090 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:51.930322 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-fe28dfa6-359c-4e6d-a438-33e80f169a32 req-a64d47d4-fe6c-4232-a210-f84189fda090 service nova] Creating event network-vif-plugged:971e49f3-13e4-4d71-a577-21b1d36cef54 for instance 8e417922-03b2-40d5-814a-4303948ed31b on hv-cinder-83607 May 26 18:07:51.937650 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-fe28dfa6-359c-4e6d-a438-33e80f169a32 req-a64d47d4-fe6c-4232-a210-f84189fda090 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041100 May 26 18:07:51.939908 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 407/844] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:07:51.947245 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-31ad1eeb-bb59-4fef-9263-24ce9e3a75be tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:51.948720 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-31ad1eeb-bb59-4fef-9263-24ce9e3a75be tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: 00f290f6-5aaa-4234-ac0b-094f19c94959] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:51.955952 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-31ad1eeb-bb59-4fef-9263-24ce9e3a75be tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:51.956743 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-31ad1eeb-bb59-4fef-9263-24ce9e3a75be tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:51.958149 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-31ad1eeb-bb59-4fef-9263-24ce9e3a75be tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:51.958999 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-31ad1eeb-bb59-4fef-9263-24ce9e3a75be tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:52.086143 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.objects.instance [None req-31ad1eeb-bb59-4fef-9263-24ce9e3a75be tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lazy-loading 'services' on Instance uuid 00f290f6-5aaa-4234-ac0b-094f19c94959 {{(pid=117723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:07:52.235394 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-872f3051-ac6f-44e6-9cd8-a8adb2dd4cff tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:52.267324 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-872f3051-ac6f-44e6-9cd8-a8adb2dd4cff tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:52.271256 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-872f3051-ac6f-44e6-9cd8-a8adb2dd4cff tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:52.283000 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-872f3051-ac6f-44e6-9cd8-a8adb2dd4cff tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1737 microversion: 2.20 time: 0.522195 May 26 18:07:52.287812 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 438/845] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:07:51 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1737 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:07:52.333014 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-31ad1eeb-bb59-4fef-9263-24ce9e3a75be tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "DELETE /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959/os-volume_attachments/8bffb7b5-cd31-4cde-9dff-b315558463d2" status: 202 len: 0 microversion: 2.1 time: 0.390611 May 26 18:07:52.339599 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 408/846] 10.222.0.69 () {58 vars in 1415 bytes} [Thu May 26 18:07:51 2022] DELETE /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959/os-volume_attachments/8bffb7b5-cd31-4cde-9dff-b315558463d2 => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:07:52.825326 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-ae42e16f-4205-4a5c-8dbd-1464d135f341 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:52.829487 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-ae42e16f-4205-4a5c-8dbd-1464d135f341 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:52.876800 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ae42e16f-4205-4a5c-8dbd-1464d135f341 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:52.878070 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ae42e16f-4205-4a5c-8dbd-1464d135f341 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:52.879631 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ae42e16f-4205-4a5c-8dbd-1464d135f341 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:52.880644 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ae42e16f-4205-4a5c-8dbd-1464d135f341 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:53.120589 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-ae42e16f-4205-4a5c-8dbd-1464d135f341 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:53.130793 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-ae42e16f-4205-4a5c-8dbd-1464d135f341 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1574 microversion: 2.1 time: 0.316700 May 26 18:07:53.131847 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 439/847] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:07:52 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1574 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:53.304639 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-8328172e-d48c-4384-880c-805ad22b5a23 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:53.305626 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-8328172e-d48c-4384-880c-805ad22b5a23 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:53.313977 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8328172e-d48c-4384-880c-805ad22b5a23 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:53.314463 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8328172e-d48c-4384-880c-805ad22b5a23 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:53.315280 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8328172e-d48c-4384-880c-805ad22b5a23 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:53.315923 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8328172e-d48c-4384-880c-805ad22b5a23 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:53.497115 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-8328172e-d48c-4384-880c-805ad22b5a23 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:53.515314 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-8328172e-d48c-4384-880c-805ad22b5a23 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:53.517510 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-8328172e-d48c-4384-880c-805ad22b5a23 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:53.518730 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-8328172e-d48c-4384-880c-805ad22b5a23 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1737 microversion: 2.20 time: 0.219011 May 26 18:07:53.519289 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 409/848] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:07:53 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1737 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:07:54.151237 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-1d6bb42d-829f-452a-a0e6-531648ec9c6a tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:54.152885 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-1d6bb42d-829f-452a-a0e6-531648ec9c6a tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:54.159771 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-1d6bb42d-829f-452a-a0e6-531648ec9c6a tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:54.160568 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-1d6bb42d-829f-452a-a0e6-531648ec9c6a tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:54.161383 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-1d6bb42d-829f-452a-a0e6-531648ec9c6a tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:54.161817 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-1d6bb42d-829f-452a-a0e6-531648ec9c6a tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:54.425455 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-1d6bb42d-829f-452a-a0e6-531648ec9c6a tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:54.433745 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-1d6bb42d-829f-452a-a0e6-531648ec9c6a tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1561 microversion: 2.1 time: 0.288524 May 26 18:07:54.434466 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 440/849] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:07:54 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1561 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:54.546789 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-deb01d89-8610-4a3e-89ee-d35969f9ed57 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:54.551889 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-deb01d89-8610-4a3e-89ee-d35969f9ed57 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:54.565161 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-deb01d89-8610-4a3e-89ee-d35969f9ed57 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:54.565905 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-deb01d89-8610-4a3e-89ee-d35969f9ed57 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:54.566940 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-deb01d89-8610-4a3e-89ee-d35969f9ed57 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:54.567574 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-deb01d89-8610-4a3e-89ee-d35969f9ed57 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:54.762701 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-f6a9b934-85be-4e26-8a6b-1e816864d645 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:54.764001 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-f6a9b934-85be-4e26-8a6b-1e816864d645 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: 00f290f6-5aaa-4234-ac0b-094f19c94959] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:54.776941 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-f6a9b934-85be-4e26-8a6b-1e816864d645 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:54.777407 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-f6a9b934-85be-4e26-8a6b-1e816864d645 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:54.778242 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-f6a9b934-85be-4e26-8a6b-1e816864d645 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:54.778650 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-f6a9b934-85be-4e26-8a6b-1e816864d645 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:54.786604 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-deb01d89-8610-4a3e-89ee-d35969f9ed57 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:54.799150 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-deb01d89-8610-4a3e-89ee-d35969f9ed57 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:54.801150 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-deb01d89-8610-4a3e-89ee-d35969f9ed57 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:54.802591 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-deb01d89-8610-4a3e-89ee-d35969f9ed57 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1719 microversion: 2.20 time: 0.259944 May 26 18:07:54.803727 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 410/850] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:07:54 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1719 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:07:54.851460 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-f6a9b934-85be-4e26-8a6b-1e816864d645 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.092763 May 26 18:07:54.853211 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 441/851] 10.222.0.69 () {58 vars in 1301 bytes} [Thu May 26 18:07:54 2022] GET /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959/os-volume_attachments => generated 25 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 26 18:07:54.999154 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-758aa3ec-7bb5-4a2e-8a6a-2047e7db2b7f tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:55.000552 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-758aa3ec-7bb5-4a2e-8a6a-2047e7db2b7f tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: 00f290f6-5aaa-4234-ac0b-094f19c94959] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:55.010070 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-758aa3ec-7bb5-4a2e-8a6a-2047e7db2b7f tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:55.011023 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-758aa3ec-7bb5-4a2e-8a6a-2047e7db2b7f tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:55.012717 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-758aa3ec-7bb5-4a2e-8a6a-2047e7db2b7f tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:55.013580 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-758aa3ec-7bb5-4a2e-8a6a-2047e7db2b7f tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:55.045371 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:55.080114 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-758aa3ec-7bb5-4a2e-8a6a-2047e7db2b7f tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.085558 May 26 18:07:55.081209 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 411/852] 10.222.0.69 () {58 vars in 1301 bytes} [Thu May 26 18:07:54 2022] GET /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959/os-volume_attachments => generated 25 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 18:07:55.153481 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-ad1145a0-c308-4ee7-bf4b-4bbec1d89fe1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:55.155753 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-ad1145a0-c308-4ee7-bf4b-4bbec1d89fe1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: 00f290f6-5aaa-4234-ac0b-094f19c94959] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:55.163842 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ad1145a0-c308-4ee7-bf4b-4bbec1d89fe1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:55.164837 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ad1145a0-c308-4ee7-bf4b-4bbec1d89fe1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:55.165960 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ad1145a0-c308-4ee7-bf4b-4bbec1d89fe1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:55.166491 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ad1145a0-c308-4ee7-bf4b-4bbec1d89fe1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:55.200177 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-ad1145a0-c308-4ee7-bf4b-4bbec1d89fe1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: 00f290f6-5aaa-4234-ac0b-094f19c94959] Going to try to terminate instance {{(pid=117722) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:07:55.296580 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-ad1145a0-c308-4ee7-bf4b-4bbec1d89fe1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "DELETE /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959" status: 204 len: 0 microversion: 2.1 time: 0.149331 May 26 18:07:55.297195 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 442/853] 10.222.0.69 () {58 vars in 1238 bytes} [Thu May 26 18:07:55 2022] DELETE /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 18:07:55.305542 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-694cd7e1-306b-4e3f-86b2-952d78e5147a tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:55.306052 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-694cd7e1-306b-4e3f-86b2-952d78e5147a tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: 00f290f6-5aaa-4234-ac0b-094f19c94959] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:55.313650 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-694cd7e1-306b-4e3f-86b2-952d78e5147a tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:55.314106 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-694cd7e1-306b-4e3f-86b2-952d78e5147a tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:55.314901 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-694cd7e1-306b-4e3f-86b2-952d78e5147a tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:55.315339 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-694cd7e1-306b-4e3f-86b2-952d78e5147a tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:55.496587 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-694cd7e1-306b-4e3f-86b2-952d78e5147a tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:55.505185 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-694cd7e1-306b-4e3f-86b2-952d78e5147a tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959" status: 200 len: 1673 microversion: 2.1 time: 0.203308 May 26 18:07:55.505494 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 412/854] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:07:55 2022] GET /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959 => generated 1673 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:55.823014 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-0d28375e-7fb0-4b69-8fcc-05fec0b28a6a tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:55.823844 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-0d28375e-7fb0-4b69-8fcc-05fec0b28a6a tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:55.830768 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0d28375e-7fb0-4b69-8fcc-05fec0b28a6a tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:55.831220 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0d28375e-7fb0-4b69-8fcc-05fec0b28a6a tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:55.832045 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0d28375e-7fb0-4b69-8fcc-05fec0b28a6a tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:55.832479 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0d28375e-7fb0-4b69-8fcc-05fec0b28a6a tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:56.069225 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-0d28375e-7fb0-4b69-8fcc-05fec0b28a6a tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:56.079635 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-0d28375e-7fb0-4b69-8fcc-05fec0b28a6a tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:56.081204 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-0d28375e-7fb0-4b69-8fcc-05fec0b28a6a tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:56.082425 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-0d28375e-7fb0-4b69-8fcc-05fec0b28a6a tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1719 microversion: 2.20 time: 0.263795 May 26 18:07:56.083197 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 443/855] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:07:55 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1719 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:07:56.525281 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-18794be0-6f63-460b-bcbc-21aa88f13e4c tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:56.526342 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-18794be0-6f63-460b-bcbc-21aa88f13e4c tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: 00f290f6-5aaa-4234-ac0b-094f19c94959] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:56.534062 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-18794be0-6f63-460b-bcbc-21aa88f13e4c tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:56.534597 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-18794be0-6f63-460b-bcbc-21aa88f13e4c tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:56.535473 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-18794be0-6f63-460b-bcbc-21aa88f13e4c tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:56.535961 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-18794be0-6f63-460b-bcbc-21aa88f13e4c tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:56.739450 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-18794be0-6f63-460b-bcbc-21aa88f13e4c tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:56.747710 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-18794be0-6f63-460b-bcbc-21aa88f13e4c tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959" status: 200 len: 1673 microversion: 2.1 time: 0.227011 May 26 18:07:56.749001 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 413/856] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:07:56 2022] GET /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959 => generated 1673 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:57.103274 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-ad5dbe05-206f-415c-80a6-46afd4bc3feb tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:57.104211 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-ad5dbe05-206f-415c-80a6-46afd4bc3feb tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:57.114244 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ad5dbe05-206f-415c-80a6-46afd4bc3feb tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:57.114842 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ad5dbe05-206f-415c-80a6-46afd4bc3feb tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:57.115867 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ad5dbe05-206f-415c-80a6-46afd4bc3feb tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:57.116526 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ad5dbe05-206f-415c-80a6-46afd4bc3feb tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:57.286758 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-ad5dbe05-206f-415c-80a6-46afd4bc3feb tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:57.295277 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-ad5dbe05-206f-415c-80a6-46afd4bc3feb tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:57.297318 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-ad5dbe05-206f-415c-80a6-46afd4bc3feb tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:57.298549 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-ad5dbe05-206f-415c-80a6-46afd4bc3feb tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1719 microversion: 2.20 time: 0.200751 May 26 18:07:57.299122 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 444/857] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:07:57 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1719 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:07:57.636855 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-b07d4925-b933-4a0b-918e-76785e7b3c10 req-81ae3cf6-fd0d-4123-a51c-d9ee768d3e53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09d62436-ae28-4b39-90d2-4530f04e4f66", "name": "network-vif-unplugged", "status": "completed", "tag": "4f4d056e-de52-4943-ab5b-725a0214cc05"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:07:57.649238 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-b07d4925-b933-4a0b-918e-76785e7b3c10 req-81ae3cf6-fd0d-4123-a51c-d9ee768d3e53 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:57.649763 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-b07d4925-b933-4a0b-918e-76785e7b3c10 req-81ae3cf6-fd0d-4123-a51c-d9ee768d3e53 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:57.662331 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-b07d4925-b933-4a0b-918e-76785e7b3c10 req-81ae3cf6-fd0d-4123-a51c-d9ee768d3e53 service nova] Creating event network-vif-unplugged:4f4d056e-de52-4943-ab5b-725a0214cc05 for instance 09d62436-ae28-4b39-90d2-4530f04e4f66 on hv-cinder-83607 May 26 18:07:57.667803 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-b07d4925-b933-4a0b-918e-76785e7b3c10 req-81ae3cf6-fd0d-4123-a51c-d9ee768d3e53 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034741 May 26 18:07:57.668749 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 414/858] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:07:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:07:57.765524 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-a5bc3aac-4e08-45af-a2e8-023a3e2ad802 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:57.766306 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-a5bc3aac-4e08-45af-a2e8-023a3e2ad802 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: 00f290f6-5aaa-4234-ac0b-094f19c94959] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:57.773565 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-a5bc3aac-4e08-45af-a2e8-023a3e2ad802 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:57.774032 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-a5bc3aac-4e08-45af-a2e8-023a3e2ad802 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:57.774840 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-a5bc3aac-4e08-45af-a2e8-023a3e2ad802 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:57.775761 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-a5bc3aac-4e08-45af-a2e8-023a3e2ad802 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:57.924592 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-a5bc3aac-4e08-45af-a2e8-023a3e2ad802 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:57.927040 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:57.935567 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-a5bc3aac-4e08-45af-a2e8-023a3e2ad802 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959" status: 200 len: 1673 microversion: 2.1 time: 0.173424 May 26 18:07:57.936641 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 445/859] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:07:57 2022] GET /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959 => generated 1673 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:58.321321 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-13ea41b7-76eb-48b6-8bea-e7ddd776d6ea tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:58.322296 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-13ea41b7-76eb-48b6-8bea-e7ddd776d6ea tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:58.332156 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-13ea41b7-76eb-48b6-8bea-e7ddd776d6ea tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:58.332953 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-13ea41b7-76eb-48b6-8bea-e7ddd776d6ea tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:58.334573 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-13ea41b7-76eb-48b6-8bea-e7ddd776d6ea tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:58.335318 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-13ea41b7-76eb-48b6-8bea-e7ddd776d6ea tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:58.529368 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-13ea41b7-76eb-48b6-8bea-e7ddd776d6ea tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:58.542722 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-13ea41b7-76eb-48b6-8bea-e7ddd776d6ea tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:58.544991 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-13ea41b7-76eb-48b6-8bea-e7ddd776d6ea tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:58.547498 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-13ea41b7-76eb-48b6-8bea-e7ddd776d6ea tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1722 microversion: 2.20 time: 0.233320 May 26 18:07:58.548429 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 415/860] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:07:58 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1722 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:07:58.570753 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-7759c4f6-7b02-430d-b45d-0c6f6a53a9eb tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e28670e-89e2-4c8d-b7f3-23653132a9ea"}} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:07:58.572485 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-7759c4f6-7b02-430d-b45d-0c6f6a53a9eb tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:58.583843 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7759c4f6-7b02-430d-b45d-0c6f6a53a9eb tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:58.584487 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7759c4f6-7b02-430d-b45d-0c6f6a53a9eb tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:58.585498 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7759c4f6-7b02-430d-b45d-0c6f6a53a9eb tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:58.586037 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7759c4f6-7b02-430d-b45d-0c6f6a53a9eb tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:58.963233 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-1a2f5444-b1e5-4f97-a95e-8ea3b93bdb88 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:58.968910 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-1a2f5444-b1e5-4f97-a95e-8ea3b93bdb88 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: 00f290f6-5aaa-4234-ac0b-094f19c94959] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:58.978915 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1a2f5444-b1e5-4f97-a95e-8ea3b93bdb88 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:58.979375 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1a2f5444-b1e5-4f97-a95e-8ea3b93bdb88 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:58.980237 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1a2f5444-b1e5-4f97-a95e-8ea3b93bdb88 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:58.980730 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1a2f5444-b1e5-4f97-a95e-8ea3b93bdb88 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:59.060695 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-7759c4f6-7b02-430d-b45d-0c6f6a53a9eb tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "POST /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.495166 May 26 18:07:59.067285 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 446/861] 10.222.0.69 () {62 vars in 1363 bytes} [Thu May 26 18:07:58 2022] POST /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66/os-volume_attachments => generated 188 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 18:07:59.220480 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-1a2f5444-b1e5-4f97-a95e-8ea3b93bdb88 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:59.245054 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-1a2f5444-b1e5-4f97-a95e-8ea3b93bdb88 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959" status: 200 len: 1673 microversion: 2.1 time: 0.293450 May 26 18:07:59.246412 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 416/862] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:07:58 2022] GET /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959 => generated 1673 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:59.317048 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-044f6c87-4398-44ba-b16e-d0b2742f2011 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:59.317929 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-044f6c87-4398-44ba-b16e-d0b2742f2011 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:59.328870 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-044f6c87-4398-44ba-b16e-d0b2742f2011 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:59.329596 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-044f6c87-4398-44ba-b16e-d0b2742f2011 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:59.331112 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-044f6c87-4398-44ba-b16e-d0b2742f2011 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:59.331919 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-044f6c87-4398-44ba-b16e-d0b2742f2011 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:59.693814 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-044f6c87-4398-44ba-b16e-d0b2742f2011 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "DELETE /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66/os-volume_attachments/4e28670e-89e2-4c8d-b7f3-23653132a9ea" status: 202 len: 0 microversion: 2.20 time: 0.384410 May 26 18:07:59.694927 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 447/863] 10.222.0.69 () {60 vars in 1456 bytes} [Thu May 26 18:07:59 2022] DELETE /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66/os-volume_attachments/4e28670e-89e2-4c8d-b7f3-23653132a9ea => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 18:07:59.782982 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-c1fa846d-c470-4bc3-ac26-c4c4b166aec4 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:07:59.783564 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-c1fa846d-c470-4bc3-ac26-c4c4b166aec4 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:59.790142 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c1fa846d-c470-4bc3-ac26-c4c4b166aec4 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:59.790637 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c1fa846d-c470-4bc3-ac26-c4c4b166aec4 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:59.791576 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c1fa846d-c470-4bc3-ac26-c4c4b166aec4 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:59.792053 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c1fa846d-c470-4bc3-ac26-c4c4b166aec4 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:59.900930 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-c1fa846d-c470-4bc3-ac26-c4c4b166aec4 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "POST /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66/action" status: 202 len: 0 microversion: 2.20 time: 0.122005 May 26 18:07:59.902078 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 417/864] 10.222.0.69 () {62 vars in 1318 bytes} [Thu May 26 18:07:59 2022] POST /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 18:07:59.912403 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-d8c946fa-8c8e-494c-989e-acc0962a7cc0 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:59.913363 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-d8c946fa-8c8e-494c-989e-acc0962a7cc0 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:59.923240 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d8c946fa-8c8e-494c-989e-acc0962a7cc0 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:59.924100 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d8c946fa-8c8e-494c-989e-acc0962a7cc0 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:59.925448 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d8c946fa-8c8e-494c-989e-acc0962a7cc0 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:59.926127 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d8c946fa-8c8e-494c-989e-acc0962a7cc0 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:00.117221 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-1e22f5ec-9b27-4f7a-8db8-111cb5ad7f5a req-0e7c868f-c5b0-4680-a470-a4f8df76d6e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00f290f6-5aaa-4234-ac0b-094f19c94959", "name": "network-vif-deleted", "tag": "74ee7604-84aa-483d-8a81-f801b551e03a"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:08:00.140337 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-1e22f5ec-9b27-4f7a-8db8-111cb5ad7f5a req-0e7c868f-c5b0-4680-a470-a4f8df76d6e0 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:00.141729 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-1e22f5ec-9b27-4f7a-8db8-111cb5ad7f5a req-0e7c868f-c5b0-4680-a470-a4f8df76d6e0 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:00.203718 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-1e22f5ec-9b27-4f7a-8db8-111cb5ad7f5a req-0e7c868f-c5b0-4680-a470-a4f8df76d6e0 service nova] Creating event network-vif-deleted:74ee7604-84aa-483d-8a81-f801b551e03a for instance 00f290f6-5aaa-4234-ac0b-094f19c94959 on hv-cinder-83607 May 26 18:08:00.211976 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-1e22f5ec-9b27-4f7a-8db8-111cb5ad7f5a req-0e7c868f-c5b0-4680-a470-a4f8df76d6e0 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099536 May 26 18:08:00.213484 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 418/865] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:08:00.266415 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-be683d48-7ee7-4179-b59c-01830563da5f tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:00.267537 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-be683d48-7ee7-4179-b59c-01830563da5f tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: 00f290f6-5aaa-4234-ac0b-094f19c94959] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:00.283876 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-be683d48-7ee7-4179-b59c-01830563da5f tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:00.284827 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-be683d48-7ee7-4179-b59c-01830563da5f tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:00.286144 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-be683d48-7ee7-4179-b59c-01830563da5f tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:00.286972 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-be683d48-7ee7-4179-b59c-01830563da5f tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:00.327816 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-be683d48-7ee7-4179-b59c-01830563da5f tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:00.328774 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-be683d48-7ee7-4179-b59c-01830563da5f tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:00.329345 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.objects.instance [None req-be683d48-7ee7-4179-b59c-01830563da5f tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lazy-loading 'fault' on Instance uuid 00f290f6-5aaa-4234-ac0b-094f19c94959 {{(pid=117723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:08:00.424455 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-be683d48-7ee7-4179-b59c-01830563da5f tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95761f42af64635b051051e397d0fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f8f4d1e7da4bfe9629717a86ba0def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:00.436552 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-d8c946fa-8c8e-494c-989e-acc0962a7cc0 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:00.439265 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-be683d48-7ee7-4179-b59c-01830563da5f tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959" status: 200 len: 1327 microversion: 2.1 time: 0.177855 May 26 18:08:00.440551 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 419/866] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:08:00 2022] GET /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959 => generated 1327 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:08:00.457564 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-d8c946fa-8c8e-494c-989e-acc0962a7cc0 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:00.459814 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-d8c946fa-8c8e-494c-989e-acc0962a7cc0 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:00.461731 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-d8c946fa-8c8e-494c-989e-acc0962a7cc0 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1670 microversion: 2.20 time: 0.554051 May 26 18:08:00.462461 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 448/867] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:07:59 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1670 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:08:01.460226 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-18cfa318-93d5-407a-b4b3-2e69d9dcf8f1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:01.461451 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-18cfa318-93d5-407a-b4b3-2e69d9dcf8f1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: 00f290f6-5aaa-4234-ac0b-094f19c94959] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:01.471647 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-18cfa318-93d5-407a-b4b3-2e69d9dcf8f1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:01.472203 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-18cfa318-93d5-407a-b4b3-2e69d9dcf8f1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:01.473040 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-18cfa318-93d5-407a-b4b3-2e69d9dcf8f1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:01.473490 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-18cfa318-93d5-407a-b4b3-2e69d9dcf8f1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:01.493226 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.wsgi [None req-18cfa318-93d5-407a-b4b3-2e69d9dcf8f1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] HTTP exception thrown: Instance 00f290f6-5aaa-4234-ac0b-094f19c94959 could not be found. May 26 18:08:01.494810 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-18cfa318-93d5-407a-b4b3-2e69d9dcf8f1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Request method failure captured: May 26 18:08:01.494810 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: request: GET /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959 HTTP/1.1 May 26 18:08:01.494810 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Accept: application/json May 26 18:08:01.494810 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Accept-Encoding: identity May 26 18:08:01.494810 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Connection: close May 26 18:08:01.494810 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Content-Length: 0 May 26 18:08:01.494810 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Content-Type: application/json May 26 18:08:01.494810 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Host: 10.222.0.69 May 26 18:08:01.494810 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Openstack-System-Scope: None May 26 18:08:01.494810 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: User-Agent: python-urllib3/1.26.9 May 26 18:08:01.494810 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Auth-Token: gAAAAABij8B3uh9t7vqZRIDnO5VGBgaQWrMP8RxBRpRaFtHMjc8Z4DbyE-hYwUMvA2jrF3XpbWCKCd5Z7a9I_DVY_c4_xnssNbVBomDYrAAlG74nxuhsZb-WEkqdyXP0Z9JyyMLWkSbb04Ly9GF3uniaAtJBGfmUy9d3lO6xsXB-xqYX1fGih5s May 26 18:08:01.494810 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Domain-Id: None May 26 18:08:01.494810 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Domain-Name: None May 26 18:08:01.494810 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Identity-Status: Confirmed May 26 18:08:01.494810 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Is-Admin-Project: True May 26 18:08:01.494810 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Domain-Id: default May 26 18:08:01.494810 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Domain-Name: Default May 26 18:08:01.494810 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Id: 79f8f4d1e7da4bfe9629717a86ba0def May 26 18:08:01.494810 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Name: tempest-AttachVolumeTestJSON-1926902253 May 26 18:08:01.494810 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Role: member,reader May 26 18:08:01.494810 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Roles: member,reader May 26 18:08:01.497809 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/79f8f4d1e7da4bfe9629717a86ba0def"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/79f8f4d1e7da4bfe9629717a86ba0def"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/79f8f4d1e7da4bfe9629717a86ba0def"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_79f8f4d1e7da4bfe9629717a86ba0def"}]}] May 26 18:08:01.497809 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant: tempest-AttachVolumeTestJSON-1926902253 May 26 18:08:01.497809 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant-Id: 79f8f4d1e7da4bfe9629717a86ba0def May 26 18:08:01.497809 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1926902253 May 26 18:08:01.497809 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User: tempest-AttachVolumeTestJSON-1926902253-project May 26 18:08:01.497809 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Domain-Id: default May 26 18:08:01.497809 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Domain-Name: Default May 26 18:08:01.497809 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Id: a95761f42af64635b051051e397d0fd1 May 26 18:08:01.497809 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Name: tempest-AttachVolumeTestJSON-1926902253-project May 26 18:08:01.497809 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: method: > May 26 18:08:01.497809 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: exception: Instance 00f290f6-5aaa-4234-ac0b-094f19c94959 could not be found. May 26 18:08:01.497809 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: action_args: {'id': '00f290f6-5aaa-4234-ac0b-094f19c94959'} May 26 18:08:01.501654 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:08:01.501654 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:01.501654 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:08:01.501654 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:08:01.501654 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:08:01.501654 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:08:01.501654 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:08:01.501654 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:08:01.501654 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:08:01.501654 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:08:01.501654 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00f290f6-5aaa-4234-ac0b-094f19c94959 could not be found. May 26 18:08:01.501654 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:01.501654 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:01.501654 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:01.501654 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:01.501654 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:08:01.501654 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:08:01.501654 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:08:01.501654 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:08:01.501654 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:08:01.508516 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:08:01.508516 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:08:01.508516 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:08:01.508516 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:08:01.508516 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:08:01.508516 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:08:01.508516 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:08:01.508516 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00f290f6-5aaa-4234-ac0b-094f19c94959 could not be found. May 26 18:08:01.508516 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:01.508516 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:01.508516 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:01.508516 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:01.508516 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:08:01.508516 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:08:01.508516 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:08:01.508516 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:08:01.508516 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00f290f6-5aaa-4234-ac0b-094f19c94959 could not be found. May 26 18:08:01.508516 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:01.512473 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-47eeec36-27f3-44d4-91ea-291365df13d6 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:01.513817 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-18cfa318-93d5-407a-b4b3-2e69d9dcf8f1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Returning 404 to user: Instance 00f290f6-5aaa-4234-ac0b-094f19c94959 could not be found. {{(pid=117723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:08:01.513817 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-18cfa318-93d5-407a-b4b3-2e69d9dcf8f1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959" status: 404 len: 111 microversion: 2.1 time: 0.041910 May 26 18:08:01.514894 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-47eeec36-27f3-44d4-91ea-291365df13d6 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:01.515132 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 420/868] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:08:01 2022] GET /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:08:01.520047 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-2ff9b815-3716-4990-af45-a23e6c1c4b71 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '.version_select at 0x7f3ab8b41940>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:01.523822 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-47eeec36-27f3-44d4-91ea-291365df13d6 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:01.524694 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-47eeec36-27f3-44d4-91ea-291365df13d6 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:01.526472 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-47eeec36-27f3-44d4-91ea-291365df13d6 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:01.527534 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-47eeec36-27f3-44d4-91ea-291365df13d6 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:01.549451 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-2ff9b815-3716-4990-af45-a23e6c1c4b71 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1485702798" status: 202 len: 0 microversion: 2.1 time: 0.038344 May 26 18:08:01.552090 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 421/869] 10.222.0.69 () {58 vars in 1220 bytes} [Thu May 26 18:08:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1485702798 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:08:01.941699 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-47eeec36-27f3-44d4-91ea-291365df13d6 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:01.957444 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-47eeec36-27f3-44d4-91ea-291365df13d6 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:01.959308 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-47eeec36-27f3-44d4-91ea-291365df13d6 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:01.960746 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-47eeec36-27f3-44d4-91ea-291365df13d6 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1728 microversion: 2.20 time: 0.474434 May 26 18:08:01.961465 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 449/870] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:08:01 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1728 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:08:02.990065 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-974e6970-62d4-425e-8e99-cb26030c14b9 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:02.990699 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-974e6970-62d4-425e-8e99-cb26030c14b9 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:03.000259 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-974e6970-62d4-425e-8e99-cb26030c14b9 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:03.000774 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-974e6970-62d4-425e-8e99-cb26030c14b9 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:03.002375 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-974e6970-62d4-425e-8e99-cb26030c14b9 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:03.003412 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-974e6970-62d4-425e-8e99-cb26030c14b9 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:03.186851 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-974e6970-62d4-425e-8e99-cb26030c14b9 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:03.203699 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-974e6970-62d4-425e-8e99-cb26030c14b9 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:03.206943 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-974e6970-62d4-425e-8e99-cb26030c14b9 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:03.210132 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-974e6970-62d4-425e-8e99-cb26030c14b9 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1728 microversion: 2.20 time: 0.227511 May 26 18:08:03.211522 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 422/871] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:08:02 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1728 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:08:04.232605 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-c1d3687a-153d-4f4f-89ba-2e3c17fb02d8 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:04.233347 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-c1d3687a-153d-4f4f-89ba-2e3c17fb02d8 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:04.240317 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c1d3687a-153d-4f4f-89ba-2e3c17fb02d8 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:04.240844 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c1d3687a-153d-4f4f-89ba-2e3c17fb02d8 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:04.241867 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c1d3687a-153d-4f4f-89ba-2e3c17fb02d8 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:04.253194 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c1d3687a-153d-4f4f-89ba-2e3c17fb02d8 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:04.538613 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-c1d3687a-153d-4f4f-89ba-2e3c17fb02d8 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:04.549295 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-c1d3687a-153d-4f4f-89ba-2e3c17fb02d8 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:04.551782 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-c1d3687a-153d-4f4f-89ba-2e3c17fb02d8 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:04.553330 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-c1d3687a-153d-4f4f-89ba-2e3c17fb02d8 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1728 microversion: 2.20 time: 0.326212 May 26 18:08:04.554112 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 450/872] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:08:04 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1728 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:08:04.990449 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-156986ae-0730-4107-a326-d33d361516a1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:04.991394 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-156986ae-0730-4107-a326-d33d361516a1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: 00f290f6-5aaa-4234-ac0b-094f19c94959] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:05.000762 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-156986ae-0730-4107-a326-d33d361516a1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:05.001357 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-156986ae-0730-4107-a326-d33d361516a1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:05.002795 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-156986ae-0730-4107-a326-d33d361516a1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:05.003223 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-156986ae-0730-4107-a326-d33d361516a1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:05.020729 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.wsgi [None req-156986ae-0730-4107-a326-d33d361516a1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] HTTP exception thrown: Instance 00f290f6-5aaa-4234-ac0b-094f19c94959 could not be found. May 26 18:08:05.022407 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-156986ae-0730-4107-a326-d33d361516a1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Request method failure captured: May 26 18:08:05.022407 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: request: DELETE /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959 HTTP/1.1 May 26 18:08:05.022407 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Accept: application/json May 26 18:08:05.022407 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Accept-Encoding: identity May 26 18:08:05.022407 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Connection: close May 26 18:08:05.022407 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Content-Length: 0 May 26 18:08:05.022407 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Content-Type: application/json May 26 18:08:05.022407 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Host: 10.222.0.69 May 26 18:08:05.022407 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Openstack-System-Scope: None May 26 18:08:05.022407 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: User-Agent: python-urllib3/1.26.9 May 26 18:08:05.022407 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Auth-Token: gAAAAABij8B3uh9t7vqZRIDnO5VGBgaQWrMP8RxBRpRaFtHMjc8Z4DbyE-hYwUMvA2jrF3XpbWCKCd5Z7a9I_DVY_c4_xnssNbVBomDYrAAlG74nxuhsZb-WEkqdyXP0Z9JyyMLWkSbb04Ly9GF3uniaAtJBGfmUy9d3lO6xsXB-xqYX1fGih5s May 26 18:08:05.022407 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Domain-Id: None May 26 18:08:05.022407 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Domain-Name: None May 26 18:08:05.022407 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Identity-Status: Confirmed May 26 18:08:05.022407 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Is-Admin-Project: True May 26 18:08:05.022407 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Domain-Id: default May 26 18:08:05.022407 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Domain-Name: Default May 26 18:08:05.022407 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Id: 79f8f4d1e7da4bfe9629717a86ba0def May 26 18:08:05.022407 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Name: tempest-AttachVolumeTestJSON-1926902253 May 26 18:08:05.022407 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Role: member,reader May 26 18:08:05.022407 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Roles: member,reader May 26 18:08:05.027829 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/79f8f4d1e7da4bfe9629717a86ba0def"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/79f8f4d1e7da4bfe9629717a86ba0def"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/79f8f4d1e7da4bfe9629717a86ba0def"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_79f8f4d1e7da4bfe9629717a86ba0def"}]}] May 26 18:08:05.027829 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant: tempest-AttachVolumeTestJSON-1926902253 May 26 18:08:05.027829 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant-Id: 79f8f4d1e7da4bfe9629717a86ba0def May 26 18:08:05.027829 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1926902253 May 26 18:08:05.027829 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User: tempest-AttachVolumeTestJSON-1926902253-project May 26 18:08:05.027829 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Domain-Id: default May 26 18:08:05.027829 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Domain-Name: Default May 26 18:08:05.027829 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Id: a95761f42af64635b051051e397d0fd1 May 26 18:08:05.027829 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Name: tempest-AttachVolumeTestJSON-1926902253-project May 26 18:08:05.027829 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: method: > May 26 18:08:05.027829 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: exception: Instance 00f290f6-5aaa-4234-ac0b-094f19c94959 could not be found. May 26 18:08:05.027829 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: action_args: {'id': '00f290f6-5aaa-4234-ac0b-094f19c94959'} May 26 18:08:05.028718 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:08:05.028718 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:05.028718 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:08:05.028718 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:08:05.028718 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:08:05.028718 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:08:05.028718 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:08:05.028718 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:08:05.028718 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:08:05.028718 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:08:05.028718 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00f290f6-5aaa-4234-ac0b-094f19c94959 could not be found. May 26 18:08:05.028718 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:05.028718 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:05.028718 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:05.028718 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:05.028718 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:08:05.028718 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:08:05.028718 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:08:05.028718 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:08:05.028718 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:08:05.030477 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:08:05.030477 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 18:08:05.030477 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 18:08:05.030477 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 18:08:05.030477 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 18:08:05.030477 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:08:05.030477 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:08:05.030477 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:08:05.030477 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:08:05.030477 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00f290f6-5aaa-4234-ac0b-094f19c94959 could not be found. May 26 18:08:05.030477 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:05.030477 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:05.030477 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:05.030477 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:05.030477 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:08:05.030477 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:08:05.030477 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:08:05.030477 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:08:05.030477 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00f290f6-5aaa-4234-ac0b-094f19c94959 could not be found. May 26 18:08:05.030477 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:05.031953 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-156986ae-0730-4107-a326-d33d361516a1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Returning 404 to user: Instance 00f290f6-5aaa-4234-ac0b-094f19c94959 could not be found. {{(pid=117723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:08:05.031953 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-156986ae-0730-4107-a326-d33d361516a1 tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "DELETE /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959" status: 404 len: 111 microversion: 2.1 time: 0.040571 May 26 18:08:05.031953 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 423/873] 10.222.0.69 () {58 vars in 1238 bytes} [Thu May 26 18:08:04 2022] DELETE /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:08:05.040595 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-9318a8a1-0cb6-42a2-a4bd-b8cdf556196a tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:05.041396 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-9318a8a1-0cb6-42a2-a4bd-b8cdf556196a tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: 00f290f6-5aaa-4234-ac0b-094f19c94959] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:05.048076 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-9318a8a1-0cb6-42a2-a4bd-b8cdf556196a tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:05.048625 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-9318a8a1-0cb6-42a2-a4bd-b8cdf556196a tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:05.049519 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-9318a8a1-0cb6-42a2-a4bd-b8cdf556196a tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:05.050043 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-9318a8a1-0cb6-42a2-a4bd-b8cdf556196a tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:05.065027 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.wsgi [None req-9318a8a1-0cb6-42a2-a4bd-b8cdf556196a tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] HTTP exception thrown: Instance 00f290f6-5aaa-4234-ac0b-094f19c94959 could not be found. May 26 18:08:05.067066 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-9318a8a1-0cb6-42a2-a4bd-b8cdf556196a tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Request method failure captured: May 26 18:08:05.067066 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: request: GET /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959 HTTP/1.1 May 26 18:08:05.067066 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Accept: application/json May 26 18:08:05.067066 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Accept-Encoding: identity May 26 18:08:05.067066 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Connection: close May 26 18:08:05.067066 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Content-Length: 0 May 26 18:08:05.067066 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Content-Type: application/json May 26 18:08:05.067066 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Host: 10.222.0.69 May 26 18:08:05.067066 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Openstack-System-Scope: None May 26 18:08:05.067066 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: User-Agent: python-urllib3/1.26.9 May 26 18:08:05.067066 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Auth-Token: gAAAAABij8B3uh9t7vqZRIDnO5VGBgaQWrMP8RxBRpRaFtHMjc8Z4DbyE-hYwUMvA2jrF3XpbWCKCd5Z7a9I_DVY_c4_xnssNbVBomDYrAAlG74nxuhsZb-WEkqdyXP0Z9JyyMLWkSbb04Ly9GF3uniaAtJBGfmUy9d3lO6xsXB-xqYX1fGih5s May 26 18:08:05.067066 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Domain-Id: None May 26 18:08:05.067066 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Domain-Name: None May 26 18:08:05.067066 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Identity-Status: Confirmed May 26 18:08:05.067066 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Is-Admin-Project: True May 26 18:08:05.067066 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Domain-Id: default May 26 18:08:05.067066 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Domain-Name: Default May 26 18:08:05.067066 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Id: 79f8f4d1e7da4bfe9629717a86ba0def May 26 18:08:05.067066 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Name: tempest-AttachVolumeTestJSON-1926902253 May 26 18:08:05.067066 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Role: member,reader May 26 18:08:05.067066 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Roles: member,reader May 26 18:08:05.068654 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/79f8f4d1e7da4bfe9629717a86ba0def"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/79f8f4d1e7da4bfe9629717a86ba0def"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/79f8f4d1e7da4bfe9629717a86ba0def"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_79f8f4d1e7da4bfe9629717a86ba0def"}]}] May 26 18:08:05.068654 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant: tempest-AttachVolumeTestJSON-1926902253 May 26 18:08:05.068654 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant-Id: 79f8f4d1e7da4bfe9629717a86ba0def May 26 18:08:05.068654 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1926902253 May 26 18:08:05.068654 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User: tempest-AttachVolumeTestJSON-1926902253-project May 26 18:08:05.068654 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Domain-Id: default May 26 18:08:05.068654 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Domain-Name: Default May 26 18:08:05.068654 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Id: a95761f42af64635b051051e397d0fd1 May 26 18:08:05.068654 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Name: tempest-AttachVolumeTestJSON-1926902253-project May 26 18:08:05.068654 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: method: > May 26 18:08:05.068654 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: exception: Instance 00f290f6-5aaa-4234-ac0b-094f19c94959 could not be found. May 26 18:08:05.068654 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: action_args: {'id': '00f290f6-5aaa-4234-ac0b-094f19c94959'} May 26 18:08:05.069538 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:08:05.069538 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:05.069538 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:08:05.069538 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:08:05.069538 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:08:05.069538 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:08:05.069538 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:08:05.069538 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:08:05.069538 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:08:05.069538 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:08:05.069538 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00f290f6-5aaa-4234-ac0b-094f19c94959 could not be found. May 26 18:08:05.069538 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:08:05.069538 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:05.069538 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:08:05.069538 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:05.069538 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:08:05.069538 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:08:05.069538 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:08:05.069538 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:08:05.069538 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:08:05.070743 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:08:05.070743 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:08:05.070743 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:08:05.070743 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:08:05.070743 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:08:05.070743 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:08:05.070743 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:08:05.070743 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00f290f6-5aaa-4234-ac0b-094f19c94959 could not be found. May 26 18:08:05.070743 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:08:05.070743 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:05.070743 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:08:05.070743 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:05.070743 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:08:05.070743 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:08:05.070743 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:08:05.070743 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:08:05.070743 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00f290f6-5aaa-4234-ac0b-094f19c94959 could not be found. May 26 18:08:05.070743 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:08:05.071853 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-9318a8a1-0cb6-42a2-a4bd-b8cdf556196a tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Returning 404 to user: Instance 00f290f6-5aaa-4234-ac0b-094f19c94959 could not be found. {{(pid=117722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:08:05.071853 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-9318a8a1-0cb6-42a2-a4bd-b8cdf556196a tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959" status: 404 len: 111 microversion: 2.1 time: 0.036336 May 26 18:08:05.071853 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 451/874] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:08:05 2022] GET /compute/v2.1/servers/00f290f6-5aaa-4234-ac0b-094f19c94959 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:08:05.576220 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-26e7a44b-8b14-4ffb-831f-397ba3dca713 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:05.577023 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-26e7a44b-8b14-4ffb-831f-397ba3dca713 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:05.589289 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-26e7a44b-8b14-4ffb-831f-397ba3dca713 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:05.589754 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-26e7a44b-8b14-4ffb-831f-397ba3dca713 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:05.590595 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-26e7a44b-8b14-4ffb-831f-397ba3dca713 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:05.591058 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-26e7a44b-8b14-4ffb-831f-397ba3dca713 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:05.793784 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-26e7a44b-8b14-4ffb-831f-397ba3dca713 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:05.808325 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-26e7a44b-8b14-4ffb-831f-397ba3dca713 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:05.810078 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-26e7a44b-8b14-4ffb-831f-397ba3dca713 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:05.811683 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-26e7a44b-8b14-4ffb-831f-397ba3dca713 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1728 microversion: 2.20 time: 0.240005 May 26 18:08:05.812631 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 424/875] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:08:05 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1728 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:08:06.251301 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-bd902102-8cca-452c-b4ea-bffda5b8a6cb tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:06.252520 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-bd902102-8cca-452c-b4ea-bffda5b8a6cb tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:06.260630 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-bd902102-8cca-452c-b4ea-bffda5b8a6cb tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:06.261187 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-bd902102-8cca-452c-b4ea-bffda5b8a6cb tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:06.262041 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-bd902102-8cca-452c-b4ea-bffda5b8a6cb tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:06.262486 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-bd902102-8cca-452c-b4ea-bffda5b8a6cb tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:06.302990 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.wsgi [None req-bd902102-8cca-452c-b4ea-bffda5b8a6cb tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] HTTP exception thrown: Instance bcca8b79-ed51-48fa-85ad-4af0a09f7c20 could not be found. May 26 18:08:06.304911 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-bd902102-8cca-452c-b4ea-bffda5b8a6cb tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Request method failure captured: May 26 18:08:06.304911 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: request: DELETE /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 HTTP/1.1 May 26 18:08:06.304911 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Accept: application/json May 26 18:08:06.304911 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Accept-Encoding: identity May 26 18:08:06.304911 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Connection: close May 26 18:08:06.304911 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Content-Length: 0 May 26 18:08:06.304911 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Content-Type: application/json May 26 18:08:06.304911 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Host: 10.222.0.69 May 26 18:08:06.304911 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Openstack-System-Scope: None May 26 18:08:06.304911 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: User-Agent: python-urllib3/1.26.9 May 26 18:08:06.304911 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Auth-Token: gAAAAABij8B3uh9t7vqZRIDnO5VGBgaQWrMP8RxBRpRaFtHMjc8Z4DbyE-hYwUMvA2jrF3XpbWCKCd5Z7a9I_DVY_c4_xnssNbVBomDYrAAlG74nxuhsZb-WEkqdyXP0Z9JyyMLWkSbb04Ly9GF3uniaAtJBGfmUy9d3lO6xsXB-xqYX1fGih5s May 26 18:08:06.304911 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Domain-Id: None May 26 18:08:06.304911 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Domain-Name: None May 26 18:08:06.304911 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Identity-Status: Confirmed May 26 18:08:06.304911 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Is-Admin-Project: True May 26 18:08:06.304911 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Domain-Id: default May 26 18:08:06.304911 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Domain-Name: Default May 26 18:08:06.304911 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Id: 79f8f4d1e7da4bfe9629717a86ba0def May 26 18:08:06.304911 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Name: tempest-AttachVolumeTestJSON-1926902253 May 26 18:08:06.304911 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Role: member,reader May 26 18:08:06.304911 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Roles: member,reader May 26 18:08:06.308253 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/79f8f4d1e7da4bfe9629717a86ba0def"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/79f8f4d1e7da4bfe9629717a86ba0def"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/79f8f4d1e7da4bfe9629717a86ba0def"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_79f8f4d1e7da4bfe9629717a86ba0def"}]}] May 26 18:08:06.308253 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant: tempest-AttachVolumeTestJSON-1926902253 May 26 18:08:06.308253 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant-Id: 79f8f4d1e7da4bfe9629717a86ba0def May 26 18:08:06.308253 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1926902253 May 26 18:08:06.308253 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User: tempest-AttachVolumeTestJSON-1926902253-project May 26 18:08:06.308253 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Domain-Id: default May 26 18:08:06.308253 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Domain-Name: Default May 26 18:08:06.308253 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Id: a95761f42af64635b051051e397d0fd1 May 26 18:08:06.308253 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Name: tempest-AttachVolumeTestJSON-1926902253-project May 26 18:08:06.308253 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: method: > May 26 18:08:06.308253 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: exception: Instance bcca8b79-ed51-48fa-85ad-4af0a09f7c20 could not be found. May 26 18:08:06.308253 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: action_args: {'id': 'bcca8b79-ed51-48fa-85ad-4af0a09f7c20'} May 26 18:08:06.310943 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:08:06.310943 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:06.310943 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:08:06.310943 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:08:06.310943 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:08:06.310943 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:08:06.310943 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:08:06.310943 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:08:06.310943 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:08:06.310943 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:08:06.310943 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcca8b79-ed51-48fa-85ad-4af0a09f7c20 could not be found. May 26 18:08:06.310943 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:08:06.310943 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:06.310943 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:08:06.310943 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:06.310943 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:08:06.310943 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:08:06.310943 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:08:06.310943 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:08:06.310943 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:08:06.315419 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:08:06.315419 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 18:08:06.315419 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 18:08:06.315419 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 18:08:06.315419 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 18:08:06.315419 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:08:06.315419 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:08:06.315419 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:08:06.315419 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:08:06.315419 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcca8b79-ed51-48fa-85ad-4af0a09f7c20 could not be found. May 26 18:08:06.315419 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:08:06.315419 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:06.315419 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:08:06.315419 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:06.315419 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:08:06.315419 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:08:06.315419 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:08:06.315419 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:08:06.315419 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcca8b79-ed51-48fa-85ad-4af0a09f7c20 could not be found. May 26 18:08:06.315419 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:08:06.321906 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-bd902102-8cca-452c-b4ea-bffda5b8a6cb tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Returning 404 to user: Instance bcca8b79-ed51-48fa-85ad-4af0a09f7c20 could not be found. {{(pid=117722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:08:06.321906 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-bd902102-8cca-452c-b4ea-bffda5b8a6cb tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "DELETE /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 404 len: 111 microversion: 2.1 time: 0.061249 May 26 18:08:06.321906 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 452/876] 10.222.0.69 () {58 vars in 1238 bytes} [Thu May 26 18:08:06 2022] DELETE /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:08:06.322843 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-13ec6e80-adb5-4486-b811-bd1d62c2a3fe tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:06.322843 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-13ec6e80-adb5-4486-b811-bd1d62c2a3fe tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] [instance: bcca8b79-ed51-48fa-85ad-4af0a09f7c20] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:06.337198 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-13ec6e80-adb5-4486-b811-bd1d62c2a3fe tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:06.337198 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-13ec6e80-adb5-4486-b811-bd1d62c2a3fe tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:06.337985 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-13ec6e80-adb5-4486-b811-bd1d62c2a3fe tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:06.337985 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-13ec6e80-adb5-4486-b811-bd1d62c2a3fe tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:06.371193 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.wsgi [None req-13ec6e80-adb5-4486-b811-bd1d62c2a3fe tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] HTTP exception thrown: Instance bcca8b79-ed51-48fa-85ad-4af0a09f7c20 could not be found. May 26 18:08:06.373278 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-13ec6e80-adb5-4486-b811-bd1d62c2a3fe tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Request method failure captured: May 26 18:08:06.373278 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: request: GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 HTTP/1.1 May 26 18:08:06.373278 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Accept: application/json May 26 18:08:06.373278 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Accept-Encoding: identity May 26 18:08:06.373278 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Connection: close May 26 18:08:06.373278 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Content-Length: 0 May 26 18:08:06.373278 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Content-Type: application/json May 26 18:08:06.373278 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Host: 10.222.0.69 May 26 18:08:06.373278 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Openstack-System-Scope: None May 26 18:08:06.373278 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: User-Agent: python-urllib3/1.26.9 May 26 18:08:06.373278 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Auth-Token: gAAAAABij8B3uh9t7vqZRIDnO5VGBgaQWrMP8RxBRpRaFtHMjc8Z4DbyE-hYwUMvA2jrF3XpbWCKCd5Z7a9I_DVY_c4_xnssNbVBomDYrAAlG74nxuhsZb-WEkqdyXP0Z9JyyMLWkSbb04Ly9GF3uniaAtJBGfmUy9d3lO6xsXB-xqYX1fGih5s May 26 18:08:06.373278 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Domain-Id: None May 26 18:08:06.373278 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Domain-Name: None May 26 18:08:06.373278 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Identity-Status: Confirmed May 26 18:08:06.373278 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Is-Admin-Project: True May 26 18:08:06.373278 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Domain-Id: default May 26 18:08:06.373278 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Domain-Name: Default May 26 18:08:06.373278 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Id: 79f8f4d1e7da4bfe9629717a86ba0def May 26 18:08:06.373278 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Name: tempest-AttachVolumeTestJSON-1926902253 May 26 18:08:06.373278 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Role: member,reader May 26 18:08:06.373278 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Roles: member,reader May 26 18:08:06.374619 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/79f8f4d1e7da4bfe9629717a86ba0def"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/79f8f4d1e7da4bfe9629717a86ba0def"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/79f8f4d1e7da4bfe9629717a86ba0def"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_79f8f4d1e7da4bfe9629717a86ba0def"}]}] May 26 18:08:06.374619 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant: tempest-AttachVolumeTestJSON-1926902253 May 26 18:08:06.374619 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant-Id: 79f8f4d1e7da4bfe9629717a86ba0def May 26 18:08:06.374619 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1926902253 May 26 18:08:06.374619 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User: tempest-AttachVolumeTestJSON-1926902253-project May 26 18:08:06.374619 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Domain-Id: default May 26 18:08:06.374619 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Domain-Name: Default May 26 18:08:06.374619 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Id: a95761f42af64635b051051e397d0fd1 May 26 18:08:06.374619 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Name: tempest-AttachVolumeTestJSON-1926902253-project May 26 18:08:06.374619 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: method: > May 26 18:08:06.374619 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: exception: Instance bcca8b79-ed51-48fa-85ad-4af0a09f7c20 could not be found. May 26 18:08:06.374619 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: action_args: {'id': 'bcca8b79-ed51-48fa-85ad-4af0a09f7c20'} May 26 18:08:06.375369 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:08:06.375369 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:06.375369 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:08:06.375369 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:08:06.375369 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:08:06.375369 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:08:06.375369 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:08:06.375369 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:08:06.375369 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:08:06.375369 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:08:06.375369 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcca8b79-ed51-48fa-85ad-4af0a09f7c20 could not be found. May 26 18:08:06.375369 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:06.375369 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:06.375369 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:06.375369 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:06.375369 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:08:06.375369 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:08:06.375369 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:08:06.375369 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:08:06.375369 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:08:06.376662 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:08:06.376662 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:08:06.376662 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:08:06.376662 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:08:06.376662 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:08:06.376662 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:08:06.376662 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:08:06.376662 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcca8b79-ed51-48fa-85ad-4af0a09f7c20 could not be found. May 26 18:08:06.376662 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:06.376662 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:06.376662 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:06.376662 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:06.376662 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:08:06.376662 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:08:06.376662 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:08:06.376662 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:08:06.376662 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcca8b79-ed51-48fa-85ad-4af0a09f7c20 could not be found. May 26 18:08:06.376662 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:06.379325 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-13ec6e80-adb5-4486-b811-bd1d62c2a3fe tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] Returning 404 to user: Instance bcca8b79-ed51-48fa-85ad-4af0a09f7c20 could not be found. {{(pid=117723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:08:06.382567 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-13ec6e80-adb5-4486-b811-bd1d62c2a3fe tempest-AttachVolumeTestJSON-1926902253 tempest-AttachVolumeTestJSON-1926902253-project] 10.222.0.69 "GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20" status: 404 len: 111 microversion: 2.1 time: 0.068525 May 26 18:08:06.382567 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 425/877] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:08:06 2022] GET /compute/v2.1/servers/bcca8b79-ed51-48fa-85ad-4af0a09f7c20 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:08:06.831439 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-ac9ad855-cb90-4c69-ad03-5a79db06a66d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:06.832109 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-ac9ad855-cb90-4c69-ad03-5a79db06a66d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:06.839164 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ac9ad855-cb90-4c69-ad03-5a79db06a66d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:06.839937 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ac9ad855-cb90-4c69-ad03-5a79db06a66d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:06.840964 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ac9ad855-cb90-4c69-ad03-5a79db06a66d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:06.841579 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ac9ad855-cb90-4c69-ad03-5a79db06a66d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:07.026128 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-ac9ad855-cb90-4c69-ad03-5a79db06a66d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:07.039125 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-ac9ad855-cb90-4c69-ad03-5a79db06a66d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:07.040873 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-ac9ad855-cb90-4c69-ad03-5a79db06a66d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:07.042052 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-ac9ad855-cb90-4c69-ad03-5a79db06a66d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1728 microversion: 2.20 time: 0.214736 May 26 18:08:07.042623 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 453/878] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:08:06 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1728 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:08:08.072500 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-08f891b4-c77d-4c4c-93f1-07b521b2752b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:08.076993 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-08f891b4-c77d-4c4c-93f1-07b521b2752b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:08.091438 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-08f891b4-c77d-4c4c-93f1-07b521b2752b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:08.092832 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-08f891b4-c77d-4c4c-93f1-07b521b2752b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:08.102364 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-08f891b4-c77d-4c4c-93f1-07b521b2752b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:08.104497 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-08f891b4-c77d-4c4c-93f1-07b521b2752b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:08.459693 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-08f891b4-c77d-4c4c-93f1-07b521b2752b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:08.483322 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-08f891b4-c77d-4c4c-93f1-07b521b2752b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:08.487420 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-08f891b4-c77d-4c4c-93f1-07b521b2752b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:08.491035 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-08f891b4-c77d-4c4c-93f1-07b521b2752b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1728 microversion: 2.20 time: 0.430925 May 26 18:08:08.492812 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 426/879] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:08:08 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1728 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:08:09.519761 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-7a107f89-73f7-4276-a76c-a563cf64f96c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:09.521036 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-7a107f89-73f7-4276-a76c-a563cf64f96c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:09.534372 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7a107f89-73f7-4276-a76c-a563cf64f96c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:09.536935 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7a107f89-73f7-4276-a76c-a563cf64f96c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:09.538384 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7a107f89-73f7-4276-a76c-a563cf64f96c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:09.543390 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7a107f89-73f7-4276-a76c-a563cf64f96c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:09.811236 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-7a107f89-73f7-4276-a76c-a563cf64f96c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:09.821667 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-7a107f89-73f7-4276-a76c-a563cf64f96c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:09.823805 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-7a107f89-73f7-4276-a76c-a563cf64f96c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:09.825315 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-7a107f89-73f7-4276-a76c-a563cf64f96c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1728 microversion: 2.20 time: 0.311533 May 26 18:08:09.827132 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 454/880] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:08:09 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1728 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:08:10.860395 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-4a4c6d62-2b8f-4d31-b481-d27b5612463d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:10.861065 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-4a4c6d62-2b8f-4d31-b481-d27b5612463d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:10.885395 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4a4c6d62-2b8f-4d31-b481-d27b5612463d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:10.885525 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4a4c6d62-2b8f-4d31-b481-d27b5612463d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:10.886249 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4a4c6d62-2b8f-4d31-b481-d27b5612463d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:10.886701 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4a4c6d62-2b8f-4d31-b481-d27b5612463d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:11.440061 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-4a4c6d62-2b8f-4d31-b481-d27b5612463d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:11.469220 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-4a4c6d62-2b8f-4d31-b481-d27b5612463d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:11.471411 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-4a4c6d62-2b8f-4d31-b481-d27b5612463d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:11.473484 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-4a4c6d62-2b8f-4d31-b481-d27b5612463d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1728 microversion: 2.20 time: 0.617998 May 26 18:08:11.474939 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 427/881] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:08:10 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1728 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:08:12.499586 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-e65f873b-a800-473e-b725-c26b065388bf tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:12.500287 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-e65f873b-a800-473e-b725-c26b065388bf tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:12.508008 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e65f873b-a800-473e-b725-c26b065388bf tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:12.508760 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e65f873b-a800-473e-b725-c26b065388bf tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:12.509557 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e65f873b-a800-473e-b725-c26b065388bf tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:12.509998 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e65f873b-a800-473e-b725-c26b065388bf tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:12.740196 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-e65f873b-a800-473e-b725-c26b065388bf tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:12.770461 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-e65f873b-a800-473e-b725-c26b065388bf tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:12.772641 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-e65f873b-a800-473e-b725-c26b065388bf tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:12.774481 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-e65f873b-a800-473e-b725-c26b065388bf tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1728 microversion: 2.20 time: 0.279602 May 26 18:08:12.775539 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 455/882] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:08:12 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1728 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:08:13.716142 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-fe7cd43e-b460-4135-9c66-51cd679e31d5 tempest-VolumesSnapshotsTestJSON-2030019378 tempest-VolumesSnapshotsTestJSON-2030019378-project] Action: 'create', calling method: .version_select at 0x7f3ab8afc8b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-317413660"}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:08:13.797449 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-a25ddc53-66f6-4966-b769-3c1e0ca5aeba tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:13.799146 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-a25ddc53-66f6-4966-b769-3c1e0ca5aeba tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:13.806467 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-a25ddc53-66f6-4966-b769-3c1e0ca5aeba tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:13.807082 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-a25ddc53-66f6-4966-b769-3c1e0ca5aeba tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:13.808251 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-a25ddc53-66f6-4966-b769-3c1e0ca5aeba tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:13.808981 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-a25ddc53-66f6-4966-b769-3c1e0ca5aeba tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:13.979536 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-a25ddc53-66f6-4966-b769-3c1e0ca5aeba tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:13.989246 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-a25ddc53-66f6-4966-b769-3c1e0ca5aeba tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:13.991741 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-a25ddc53-66f6-4966-b769-3c1e0ca5aeba tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:13.993522 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-a25ddc53-66f6-4966-b769-3c1e0ca5aeba tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1728 microversion: 2.20 time: 0.202204 May 26 18:08:13.994481 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 456/883] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:08:13 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1728 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:08:14.141757 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-fe7cd43e-b460-4135-9c66-51cd679e31d5 tempest-VolumesSnapshotsTestJSON-2030019378 tempest-VolumesSnapshotsTestJSON-2030019378-project] 10.222.0.69 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.571650 May 26 18:08:14.142952 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 428/884] 10.222.0.69 () {60 vars in 1154 bytes} [Thu May 26 18:08:13 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 573 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 26 18:08:14.155297 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-7280fdb5-090d-4bfc-81c4-c9015573a052 tempest-VolumesSnapshotsTestJSON-2030019378 tempest-VolumesSnapshotsTestJSON-2030019378-project] Calling method '.version_select at 0x7f3ab8a535e0>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:14.206684 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-7280fdb5-090d-4bfc-81c4-c9015573a052 tempest-VolumesSnapshotsTestJSON-2030019378 tempest-VolumesSnapshotsTestJSON-2030019378-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/eb1aafb7-2ee3-44b4-be41-a46e6461d88e" status: 200 len: 344 microversion: 2.1 time: 0.056416 May 26 18:08:14.211670 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 457/885] 10.222.0.69 () {58 vars in 1244 bytes} [Thu May 26 18:08:14 2022] GET /compute/v2.1/os-volumes/eb1aafb7-2ee3-44b4-be41-a46e6461d88e => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:08:15.014139 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-293e1297-a5dc-46fe-ab49-7c36772d0a0b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:15.014672 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-293e1297-a5dc-46fe-ab49-7c36772d0a0b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:15.021911 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-293e1297-a5dc-46fe-ab49-7c36772d0a0b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:15.022432 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-293e1297-a5dc-46fe-ab49-7c36772d0a0b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:15.023139 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-293e1297-a5dc-46fe-ab49-7c36772d0a0b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:15.023588 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-293e1297-a5dc-46fe-ab49-7c36772d0a0b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:15.172907 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-293e1297-a5dc-46fe-ab49-7c36772d0a0b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:15.182026 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-293e1297-a5dc-46fe-ab49-7c36772d0a0b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:15.183489 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-293e1297-a5dc-46fe-ab49-7c36772d0a0b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:15.184748 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-293e1297-a5dc-46fe-ab49-7c36772d0a0b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1728 microversion: 2.20 time: 0.175423 May 26 18:08:15.195703 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 429/886] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:08:15 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1728 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:08:15.220851 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-8c998520-2dba-4b82-9514-a686d63c9e60 tempest-VolumesSnapshotsTestJSON-2030019378 tempest-VolumesSnapshotsTestJSON-2030019378-project] Calling method '.version_select at 0x7f3ab8cc4ca0>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:15.272481 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-8c998520-2dba-4b82-9514-a686d63c9e60 tempest-VolumesSnapshotsTestJSON-2030019378 tempest-VolumesSnapshotsTestJSON-2030019378-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/eb1aafb7-2ee3-44b4-be41-a46e6461d88e" status: 200 len: 345 microversion: 2.1 time: 0.057358 May 26 18:08:15.273073 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 458/887] 10.222.0.69 () {58 vars in 1244 bytes} [Thu May 26 18:08:15 2022] GET /compute/v2.1/os-volumes/eb1aafb7-2ee3-44b4-be41-a46e6461d88e => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:08:15.284925 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-4159e757-74bf-4a2f-bc9b-97616991052d tempest-VolumesSnapshotsTestJSON-2030019378 tempest-VolumesSnapshotsTestJSON-2030019378-project] Action: 'create', calling method: .version_select at 0x7f3ab8afc9d0>, body: {"snapshot": {"volume_id": "eb1aafb7-2ee3-44b4-be41-a46e6461d88e", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-877027117"}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:08:15.441826 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-4159e757-74bf-4a2f-bc9b-97616991052d tempest-VolumesSnapshotsTestJSON-2030019378 tempest-VolumesSnapshotsTestJSON-2030019378-project] 10.222.0.69 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.160800 May 26 18:08:15.442410 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 430/888] 10.222.0.69 () {60 vars in 1161 bytes} [Thu May 26 18:08:15 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:08:15.454462 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-956d17df-c4d5-45aa-a737-c2ee58826cc0 tempest-VolumesSnapshotsTestJSON-2030019378 tempest-VolumesSnapshotsTestJSON-2030019378-project] Calling method '.version_select at 0x7f3ab8a69820>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:15.488955 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-956d17df-c4d5-45aa-a737-c2ee58826cc0 tempest-VolumesSnapshotsTestJSON-2030019378 tempest-VolumesSnapshotsTestJSON-2030019378-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/33bdb01c-bd79-430d-ae34-60dcbf568bf1" status: 200 len: 286 microversion: 2.1 time: 0.039812 May 26 18:08:15.489522 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 459/889] 10.222.0.69 () {58 vars in 1250 bytes} [Thu May 26 18:08:15 2022] GET /compute/v2.1/os-snapshots/33bdb01c-bd79-430d-ae34-60dcbf568bf1 => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:08:15.499312 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-1bb064a1-8988-433b-a45e-b49d153e5db9 tempest-VolumesSnapshotsTestJSON-2030019378 tempest-VolumesSnapshotsTestJSON-2030019378-project] Calling method '.version_select at 0x7f3ab8afe1f0>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:15.530109 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-1bb064a1-8988-433b-a45e-b49d153e5db9 tempest-VolumesSnapshotsTestJSON-2030019378 tempest-VolumesSnapshotsTestJSON-2030019378-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.034579 May 26 18:08:15.530765 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 431/890] 10.222.0.69 () {58 vars in 1139 bytes} [Thu May 26 18:08:15 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:08:15.540890 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-80037550-25a5-4f94-ae24-2a2a34fc0bc2 tempest-VolumesSnapshotsTestJSON-2030019378 tempest-VolumesSnapshotsTestJSON-2030019378-project] Calling method '.version_select at 0x7f3ab8a56670>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:15.571298 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-80037550-25a5-4f94-ae24-2a2a34fc0bc2 tempest-VolumesSnapshotsTestJSON-2030019378 tempest-VolumesSnapshotsTestJSON-2030019378-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/33bdb01c-bd79-430d-ae34-60dcbf568bf1" status: 200 len: 286 microversion: 2.1 time: 0.034111 May 26 18:08:15.571878 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 460/891] 10.222.0.69 () {58 vars in 1250 bytes} [Thu May 26 18:08:15 2022] GET /compute/v2.1/os-snapshots/33bdb01c-bd79-430d-ae34-60dcbf568bf1 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:08:16.205934 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-7832d30f-d097-4a25-a07d-268401bdb54c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:16.206571 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-7832d30f-d097-4a25-a07d-268401bdb54c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:16.213617 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7832d30f-d097-4a25-a07d-268401bdb54c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:16.214070 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7832d30f-d097-4a25-a07d-268401bdb54c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:16.214857 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7832d30f-d097-4a25-a07d-268401bdb54c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:16.215298 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7832d30f-d097-4a25-a07d-268401bdb54c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:16.357065 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-7832d30f-d097-4a25-a07d-268401bdb54c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:16.366041 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-7832d30f-d097-4a25-a07d-268401bdb54c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:16.367843 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-7832d30f-d097-4a25-a07d-268401bdb54c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:16.368815 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-7832d30f-d097-4a25-a07d-268401bdb54c tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1728 microversion: 2.20 time: 0.167972 May 26 18:08:16.369833 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 432/892] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:08:16 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1728 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:08:16.584330 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-4d7c53f8-856f-4bdc-b27d-ccdccb06cd4a tempest-VolumesSnapshotsTestJSON-2030019378 tempest-VolumesSnapshotsTestJSON-2030019378-project] Calling method '.version_select at 0x7f3ab8c3dd30>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:16.618784 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-4d7c53f8-856f-4bdc-b27d-ccdccb06cd4a tempest-VolumesSnapshotsTestJSON-2030019378 tempest-VolumesSnapshotsTestJSON-2030019378-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/33bdb01c-bd79-430d-ae34-60dcbf568bf1" status: 200 len: 286 microversion: 2.1 time: 0.038711 May 26 18:08:16.619364 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 461/893] 10.222.0.69 () {58 vars in 1250 bytes} [Thu May 26 18:08:16 2022] GET /compute/v2.1/os-snapshots/33bdb01c-bd79-430d-ae34-60dcbf568bf1 => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:08:17.391609 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-49ef86ef-e717-4df7-81c8-3fdbbea2cbd7 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:17.392286 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-49ef86ef-e717-4df7-81c8-3fdbbea2cbd7 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:17.398849 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-49ef86ef-e717-4df7-81c8-3fdbbea2cbd7 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:17.399306 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-49ef86ef-e717-4df7-81c8-3fdbbea2cbd7 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:17.400126 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-49ef86ef-e717-4df7-81c8-3fdbbea2cbd7 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:17.400570 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-49ef86ef-e717-4df7-81c8-3fdbbea2cbd7 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:17.537819 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-49ef86ef-e717-4df7-81c8-3fdbbea2cbd7 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:17.546603 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-49ef86ef-e717-4df7-81c8-3fdbbea2cbd7 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:17.548149 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-49ef86ef-e717-4df7-81c8-3fdbbea2cbd7 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:17.549314 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-49ef86ef-e717-4df7-81c8-3fdbbea2cbd7 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1728 microversion: 2.20 time: 0.162373 May 26 18:08:17.549874 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 433/894] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:08:17 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:08:17.632651 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-f1debf78-ffed-427f-9c01-a7eb26158c49 tempest-VolumesSnapshotsTestJSON-2030019378 tempest-VolumesSnapshotsTestJSON-2030019378-project] Calling method '.version_select at 0x7f3ab8d1c1f0>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:17.668809 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-f1debf78-ffed-427f-9c01-a7eb26158c49 tempest-VolumesSnapshotsTestJSON-2030019378 tempest-VolumesSnapshotsTestJSON-2030019378-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/33bdb01c-bd79-430d-ae34-60dcbf568bf1" status: 200 len: 286 microversion: 2.1 time: 0.040581 May 26 18:08:17.669571 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 462/895] 10.222.0.69 () {58 vars in 1250 bytes} [Thu May 26 18:08:17 2022] GET /compute/v2.1/os-snapshots/33bdb01c-bd79-430d-ae34-60dcbf568bf1 => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:08:18.567504 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-9cc9aec7-45c5-4940-8c7d-80bc82186952 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:18.568116 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-9cc9aec7-45c5-4940-8c7d-80bc82186952 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:18.575153 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9cc9aec7-45c5-4940-8c7d-80bc82186952 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:18.575606 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9cc9aec7-45c5-4940-8c7d-80bc82186952 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:18.576437 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9cc9aec7-45c5-4940-8c7d-80bc82186952 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:18.576880 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9cc9aec7-45c5-4940-8c7d-80bc82186952 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:18.580115 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:18.682888 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-8f378137-f380-459b-815e-9fa965c326b8 tempest-VolumesSnapshotsTestJSON-2030019378 tempest-VolumesSnapshotsTestJSON-2030019378-project] Calling method '.version_select at 0x7f3ab8a53ca0>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:18.724445 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-8f378137-f380-459b-815e-9fa965c326b8 tempest-VolumesSnapshotsTestJSON-2030019378 tempest-VolumesSnapshotsTestJSON-2030019378-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/33bdb01c-bd79-430d-ae34-60dcbf568bf1" status: 200 len: 286 microversion: 2.1 time: 0.047569 May 26 18:08:18.725036 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 463/896] 10.222.0.69 () {58 vars in 1250 bytes} [Thu May 26 18:08:18 2022] GET /compute/v2.1/os-snapshots/33bdb01c-bd79-430d-ae34-60dcbf568bf1 => generated 286 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:08:18.736609 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-9cc9aec7-45c5-4940-8c7d-80bc82186952 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:18.745155 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-9cc9aec7-45c5-4940-8c7d-80bc82186952 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:18.746688 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-9cc9aec7-45c5-4940-8c7d-80bc82186952 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:18.747907 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-9cc9aec7-45c5-4940-8c7d-80bc82186952 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1728 microversion: 2.20 time: 0.184563 May 26 18:08:18.748520 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 434/897] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:08:18 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1728 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:08:19.737472 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-577ed426-37e2-4191-8bb7-92019e176a98 tempest-VolumesSnapshotsTestJSON-2030019378 tempest-VolumesSnapshotsTestJSON-2030019378-project] Calling method '.version_select at 0x7f3ab8d1c0d0>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:19.766351 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-9af6177e-2563-4341-8402-8d73920bfcbe tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:19.767034 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-9af6177e-2563-4341-8402-8d73920bfcbe tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:19.769421 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_api:SELECT=65,nova_api:DELETE=1 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:19.773793 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-577ed426-37e2-4191-8bb7-92019e176a98 tempest-VolumesSnapshotsTestJSON-2030019378 tempest-VolumesSnapshotsTestJSON-2030019378-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/33bdb01c-bd79-430d-ae34-60dcbf568bf1" status: 200 len: 286 microversion: 2.1 time: 0.040641 May 26 18:08:19.774638 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 464/898] 10.222.0.69 () {58 vars in 1250 bytes} [Thu May 26 18:08:19 2022] GET /compute/v2.1/os-snapshots/33bdb01c-bd79-430d-ae34-60dcbf568bf1 => generated 286 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:08:19.775263 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9af6177e-2563-4341-8402-8d73920bfcbe tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:19.775819 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9af6177e-2563-4341-8402-8d73920bfcbe tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:19.776649 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9af6177e-2563-4341-8402-8d73920bfcbe tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:19.777098 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9af6177e-2563-4341-8402-8d73920bfcbe tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:19.922369 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-9af6177e-2563-4341-8402-8d73920bfcbe tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:19.931217 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-9af6177e-2563-4341-8402-8d73920bfcbe tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:19.932798 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-9af6177e-2563-4341-8402-8d73920bfcbe tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:19.934000 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-9af6177e-2563-4341-8402-8d73920bfcbe tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1728 microversion: 2.20 time: 0.171572 May 26 18:08:19.934581 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 435/899] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:08:19 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1728 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:08:20.787698 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-b5ee6a28-25d2-47da-b5bd-a9e2b196b1cc tempest-VolumesSnapshotsTestJSON-2030019378 tempest-VolumesSnapshotsTestJSON-2030019378-project] Calling method '.version_select at 0x7f3ab8dc9a60>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:20.822191 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-b5ee6a28-25d2-47da-b5bd-a9e2b196b1cc tempest-VolumesSnapshotsTestJSON-2030019378 tempest-VolumesSnapshotsTestJSON-2030019378-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/33bdb01c-bd79-430d-ae34-60dcbf568bf1" status: 200 len: 286 microversion: 2.1 time: 0.038860 May 26 18:08:20.822906 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 465/900] 10.222.0.69 () {58 vars in 1250 bytes} [Thu May 26 18:08:20 2022] GET /compute/v2.1/os-snapshots/33bdb01c-bd79-430d-ae34-60dcbf568bf1 => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:08:20.953397 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-2f54e550-7b5d-422b-b17a-82df03b3e3f2 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:20.954171 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-2f54e550-7b5d-422b-b17a-82df03b3e3f2 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:20.962115 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2f54e550-7b5d-422b-b17a-82df03b3e3f2 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:20.962571 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2f54e550-7b5d-422b-b17a-82df03b3e3f2 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:20.963379 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2f54e550-7b5d-422b-b17a-82df03b3e3f2 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:20.963829 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2f54e550-7b5d-422b-b17a-82df03b3e3f2 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:21.153361 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-2f54e550-7b5d-422b-b17a-82df03b3e3f2 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:21.162844 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-2f54e550-7b5d-422b-b17a-82df03b3e3f2 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:21.166710 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-2f54e550-7b5d-422b-b17a-82df03b3e3f2 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:21.168723 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-2f54e550-7b5d-422b-b17a-82df03b3e3f2 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1728 microversion: 2.20 time: 0.219999 May 26 18:08:21.169601 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 436/901] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:08:20 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1728 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:08:21.777629 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [req-a6d8d113-d060-45b5-ab74-8b12aa60a06f req-5ec595d8-0b82-46c7-b720-387c08e82f36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09d62436-ae28-4b39-90d2-4530f04e4f66", "name": "network-vif-plugged", "status": "completed", "tag": "4f4d056e-de52-4943-ab5b-725a0214cc05"}]} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:08:21.783417 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:21.790235 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-a6d8d113-d060-45b5-ab74-8b12aa60a06f req-5ec595d8-0b82-46c7-b720-387c08e82f36 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:21.791437 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-a6d8d113-d060-45b5-ab74-8b12aa60a06f req-5ec595d8-0b82-46c7-b720-387c08e82f36 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:21.803812 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.compute.server_external_events [req-a6d8d113-d060-45b5-ab74-8b12aa60a06f req-5ec595d8-0b82-46c7-b720-387c08e82f36 service nova] Creating event network-vif-plugged:4f4d056e-de52-4943-ab5b-725a0214cc05 for instance 09d62436-ae28-4b39-90d2-4530f04e4f66 on hv-cinder-83607 May 26 18:08:21.813025 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [req-a6d8d113-d060-45b5-ab74-8b12aa60a06f req-5ec595d8-0b82-46c7-b720-387c08e82f36 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054321 May 26 18:08:21.815148 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 466/902] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:08:21.855092 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-cc282c10-b8a9-49d2-8b60-8dd648eff533 tempest-VolumesSnapshotsTestJSON-2030019378 tempest-VolumesSnapshotsTestJSON-2030019378-project] Calling method '.version_select at 0x7f3ab8afc8b0>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:21.926880 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-cc282c10-b8a9-49d2-8b60-8dd648eff533 tempest-VolumesSnapshotsTestJSON-2030019378 tempest-VolumesSnapshotsTestJSON-2030019378-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/33bdb01c-bd79-430d-ae34-60dcbf568bf1" status: 200 len: 287 microversion: 2.1 time: 0.093166 May 26 18:08:21.927802 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 437/903] 10.222.0.69 () {58 vars in 1250 bytes} [Thu May 26 18:08:21 2022] GET /compute/v2.1/os-snapshots/33bdb01c-bd79-430d-ae34-60dcbf568bf1 => generated 287 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:08:21.948054 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-e04d425e-e300-474c-82c0-2b4ad5f26ff9 tempest-VolumesSnapshotsTestJSON-2030019378 tempest-VolumesSnapshotsTestJSON-2030019378-project] Calling method '.version_select at 0x7f3ab8d1c0d0>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:22.036192 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-e04d425e-e300-474c-82c0-2b4ad5f26ff9 tempest-VolumesSnapshotsTestJSON-2030019378 tempest-VolumesSnapshotsTestJSON-2030019378-project] 10.222.0.69 "DELETE /compute/v2.1/os-snapshots/33bdb01c-bd79-430d-ae34-60dcbf568bf1" status: 202 len: 0 microversion: 2.1 time: 0.097522 May 26 18:08:22.037287 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 467/904] 10.222.0.69 () {58 vars in 1253 bytes} [Thu May 26 18:08:21 2022] DELETE /compute/v2.1/os-snapshots/33bdb01c-bd79-430d-ae34-60dcbf568bf1 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:08:22.047555 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-4c7d531d-7ed2-4c9f-94e9-37c1312d9e0e tempest-VolumesSnapshotsTestJSON-2030019378 tempest-VolumesSnapshotsTestJSON-2030019378-project] Calling method '.version_select at 0x7f3ab8afe040>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:22.082819 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-4c7d531d-7ed2-4c9f-94e9-37c1312d9e0e tempest-VolumesSnapshotsTestJSON-2030019378 tempest-VolumesSnapshotsTestJSON-2030019378-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/33bdb01c-bd79-430d-ae34-60dcbf568bf1" status: 200 len: 286 microversion: 2.1 time: 0.040752 May 26 18:08:22.083732 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 438/905] 10.222.0.69 () {58 vars in 1250 bytes} [Thu May 26 18:08:22 2022] GET /compute/v2.1/os-snapshots/33bdb01c-bd79-430d-ae34-60dcbf568bf1 => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:08:22.193462 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-a61c1a53-6ed9-483d-b034-12c4fcccd8c1 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:22.194803 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-a61c1a53-6ed9-483d-b034-12c4fcccd8c1 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:22.205290 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-a61c1a53-6ed9-483d-b034-12c4fcccd8c1 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:22.205747 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-a61c1a53-6ed9-483d-b034-12c4fcccd8c1 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:22.206609 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-a61c1a53-6ed9-483d-b034-12c4fcccd8c1 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:22.207050 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-a61c1a53-6ed9-483d-b034-12c4fcccd8c1 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:22.364711 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-a61c1a53-6ed9-483d-b034-12c4fcccd8c1 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:22.375475 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-a61c1a53-6ed9-483d-b034-12c4fcccd8c1 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:22.377069 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-a61c1a53-6ed9-483d-b034-12c4fcccd8c1 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:22.378370 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-a61c1a53-6ed9-483d-b034-12c4fcccd8c1 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1728 microversion: 2.20 time: 0.193516 May 26 18:08:22.378941 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 468/906] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:08:22 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1728 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:08:23.098949 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-317d74f4-f4a6-4edc-a8e8-9f768af29564 tempest-VolumesSnapshotsTestJSON-2030019378 tempest-VolumesSnapshotsTestJSON-2030019378-project] Calling method '.version_select at 0x7f3ab8b9eee0>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:23.134127 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.wsgi [None req-317d74f4-f4a6-4edc-a8e8-9f768af29564 tempest-VolumesSnapshotsTestJSON-2030019378 tempest-VolumesSnapshotsTestJSON-2030019378-project] HTTP exception thrown: Snapshot 33bdb01c-bd79-430d-ae34-60dcbf568bf1 could not be found. May 26 18:08:23.138284 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-317d74f4-f4a6-4edc-a8e8-9f768af29564 tempest-VolumesSnapshotsTestJSON-2030019378 tempest-VolumesSnapshotsTestJSON-2030019378-project] Request method failure captured: May 26 18:08:23.138284 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: request: GET /compute/v2.1/os-snapshots/33bdb01c-bd79-430d-ae34-60dcbf568bf1 HTTP/1.1 May 26 18:08:23.138284 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Accept: application/json May 26 18:08:23.138284 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Accept-Encoding: identity May 26 18:08:23.138284 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Connection: close May 26 18:08:23.138284 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Content-Length: 0 May 26 18:08:23.138284 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Content-Type: application/json May 26 18:08:23.138284 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Host: 10.222.0.69 May 26 18:08:23.138284 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Openstack-System-Scope: None May 26 18:08:23.138284 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: User-Agent: python-urllib3/1.26.9 May 26 18:08:23.138284 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Auth-Token: gAAAAABij8IN9cIjwADUIsl1q3y3-rNxLOMjbxk42lGJw5VeYBxcHRebqtRh3be_Hv85AJw6SKK95unnbc5fOpTDPgw6SvHJluyoPwl_If7aY5qXZGuQv0eFYH7d_qy4ASss2HD39vmX1UbzM7unGKOv6CpzaG1suW-tB-GzD2TOmHmKHJH-PQc May 26 18:08:23.138284 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Domain-Id: None May 26 18:08:23.138284 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Domain-Name: None May 26 18:08:23.138284 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Identity-Status: Confirmed May 26 18:08:23.138284 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Is-Admin-Project: True May 26 18:08:23.138284 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Domain-Id: default May 26 18:08:23.138284 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Domain-Name: Default May 26 18:08:23.138284 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Id: 2d8a7527f46d4e0d8d8fb538353a4ab1 May 26 18:08:23.138284 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2030019378 May 26 18:08:23.138284 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Role: member,reader May 26 18:08:23.138284 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Roles: member,reader May 26 18:08:23.140087 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2d8a7527f46d4e0d8d8fb538353a4ab1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/2d8a7527f46d4e0d8d8fb538353a4ab1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2d8a7527f46d4e0d8d8fb538353a4ab1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_2d8a7527f46d4e0d8d8fb538353a4ab1"}]}] May 26 18:08:23.140087 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2030019378 May 26 18:08:23.140087 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant-Id: 2d8a7527f46d4e0d8d8fb538353a4ab1 May 26 18:08:23.140087 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2030019378 May 26 18:08:23.140087 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User: tempest-VolumesSnapshotsTestJSON-2030019378-project May 26 18:08:23.140087 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Domain-Id: default May 26 18:08:23.140087 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Domain-Name: Default May 26 18:08:23.140087 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Id: b0acebd9631b4f2ca18c2463da2c7d03 May 26 18:08:23.140087 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2030019378-project May 26 18:08:23.140087 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: method: May 26 18:08:23.140087 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: exception: Snapshot 33bdb01c-bd79-430d-ae34-60dcbf568bf1 could not be found. May 26 18:08:23.140087 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: action_args: {'id': '33bdb01c-bd79-430d-ae34-60dcbf568bf1'} May 26 18:08:23.140087 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:08:23.140932 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:23.140932 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 26 18:08:23.140932 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 26 18:08:23.140932 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 26 18:08:23.140932 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 26 18:08:23.140932 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 26 18:08:23.140932 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 26 18:08:23.140932 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 18:08:23.140932 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 18:08:23.140932 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 18:08:23.140932 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 18:08:23.140932 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 18:08:23.140932 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 18:08:23.140932 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 18:08:23.140932 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 18:08:23.140932 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 33bdb01c-bd79-430d-ae34-60dcbf568bf1 could not be found. (HTTP 404) (Request-ID: req-e7224e38-74d0-4f12-9094-6e3f4b51ac90) May 26 18:08:23.140932 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:23.140932 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:23.142105 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:23.142105 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:23.142105 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 26 18:08:23.142105 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 26 18:08:23.142105 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 18:08:23.142105 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 18:08:23.142105 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 26 18:08:23.142105 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 26 18:08:23.142105 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 18:08:23.142105 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 18:08:23.142105 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 26 18:08:23.142105 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 26 18:08:23.142105 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 26 18:08:23.142105 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 26 18:08:23.142105 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 26 18:08:23.142105 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 26 18:08:23.142105 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 18:08:23.142105 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 18:08:23.142105 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 18:08:23.143273 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 18:08:23.143273 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 18:08:23.143273 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 18:08:23.143273 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 18:08:23.143273 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 18:08:23.143273 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 33bdb01c-bd79-430d-ae34-60dcbf568bf1 could not be found. May 26 18:08:23.143273 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:23.143273 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:23.143273 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:23.143273 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:23.143273 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:08:23.143273 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:08:23.143273 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:08:23.143273 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:08:23.143273 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 18:08:23.143273 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 18:08:23.143273 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:08:23.143273 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:08:23.143273 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 26 18:08:23.143273 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:08:23.144586 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 33bdb01c-bd79-430d-ae34-60dcbf568bf1 could not be found. May 26 18:08:23.144586 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:23.144586 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:23.144586 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:23.144586 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:23.144586 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:08:23.144586 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:08:23.144586 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:08:23.144586 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:08:23.144586 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 33bdb01c-bd79-430d-ae34-60dcbf568bf1 could not be found. May 26 18:08:23.144586 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:23.144586 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-317d74f4-f4a6-4edc-a8e8-9f768af29564 tempest-VolumesSnapshotsTestJSON-2030019378 tempest-VolumesSnapshotsTestJSON-2030019378-project] Returning 404 to user: Snapshot 33bdb01c-bd79-430d-ae34-60dcbf568bf1 could not be found. {{(pid=117723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:08:23.144586 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-317d74f4-f4a6-4edc-a8e8-9f768af29564 tempest-VolumesSnapshotsTestJSON-2030019378 tempest-VolumesSnapshotsTestJSON-2030019378-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/33bdb01c-bd79-430d-ae34-60dcbf568bf1" status: 404 len: 111 microversion: 2.1 time: 0.047218 May 26 18:08:23.145412 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 439/907] 10.222.0.69 () {58 vars in 1250 bytes} [Thu May 26 18:08:23 2022] GET /compute/v2.1/os-snapshots/33bdb01c-bd79-430d-ae34-60dcbf568bf1 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:08:23.155552 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-35a521e3-468f-45f5-a0e9-9055b02b9d5d tempest-VolumesSnapshotsTestJSON-2030019378 tempest-VolumesSnapshotsTestJSON-2030019378-project] Calling method '.version_select at 0x7f3ab8dc99d0>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:23.238729 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-35a521e3-468f-45f5-a0e9-9055b02b9d5d tempest-VolumesSnapshotsTestJSON-2030019378 tempest-VolumesSnapshotsTestJSON-2030019378-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/eb1aafb7-2ee3-44b4-be41-a46e6461d88e" status: 202 len: 0 microversion: 2.1 time: 0.090285 May 26 18:08:23.239868 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 469/908] 10.222.0.69 () {58 vars in 1247 bytes} [Thu May 26 18:08:23 2022] DELETE /compute/v2.1/os-volumes/eb1aafb7-2ee3-44b4-be41-a46e6461d88e => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:08:23.248994 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-de102e26-5424-4220-9630-d310e1938c9a tempest-VolumesSnapshotsTestJSON-2030019378 tempest-VolumesSnapshotsTestJSON-2030019378-project] Calling method '.version_select at 0x7f3ab8c1b9d0>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:23.338930 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-de102e26-5424-4220-9630-d310e1938c9a tempest-VolumesSnapshotsTestJSON-2030019378 tempest-VolumesSnapshotsTestJSON-2030019378-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/eb1aafb7-2ee3-44b4-be41-a46e6461d88e" status: 200 len: 344 microversion: 2.1 time: 0.093929 May 26 18:08:23.340104 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 440/909] 10.222.0.69 () {58 vars in 1244 bytes} [Thu May 26 18:08:23 2022] GET /compute/v2.1/os-volumes/eb1aafb7-2ee3-44b4-be41-a46e6461d88e => generated 344 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:08:23.403840 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-866fe819-a59a-4d0b-9f9a-e8ae2e899ea7 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:23.405092 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-866fe819-a59a-4d0b-9f9a-e8ae2e899ea7 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:23.416491 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-866fe819-a59a-4d0b-9f9a-e8ae2e899ea7 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:23.417779 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-866fe819-a59a-4d0b-9f9a-e8ae2e899ea7 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:23.419905 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-866fe819-a59a-4d0b-9f9a-e8ae2e899ea7 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:23.420923 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-866fe819-a59a-4d0b-9f9a-e8ae2e899ea7 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:23.429881 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:23.674651 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-866fe819-a59a-4d0b-9f9a-e8ae2e899ea7 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:23.686617 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-866fe819-a59a-4d0b-9f9a-e8ae2e899ea7 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:23.687738 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-866fe819-a59a-4d0b-9f9a-e8ae2e899ea7 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:23.689008 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-866fe819-a59a-4d0b-9f9a-e8ae2e899ea7 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1728 microversion: 2.20 time: 0.293801 May 26 18:08:23.689583 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 470/910] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:08:23 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1728 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:08:24.357323 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-b508b95b-6b81-44f1-b67f-e041e6fce24e tempest-VolumesSnapshotsTestJSON-2030019378 tempest-VolumesSnapshotsTestJSON-2030019378-project] Calling method '.version_select at 0x7f3ab8b9ec10>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:24.388832 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.wsgi [None req-b508b95b-6b81-44f1-b67f-e041e6fce24e tempest-VolumesSnapshotsTestJSON-2030019378 tempest-VolumesSnapshotsTestJSON-2030019378-project] HTTP exception thrown: Volume eb1aafb7-2ee3-44b4-be41-a46e6461d88e could not be found. May 26 18:08:24.391375 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-b508b95b-6b81-44f1-b67f-e041e6fce24e tempest-VolumesSnapshotsTestJSON-2030019378 tempest-VolumesSnapshotsTestJSON-2030019378-project] Request method failure captured: May 26 18:08:24.391375 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: request: GET /compute/v2.1/os-volumes/eb1aafb7-2ee3-44b4-be41-a46e6461d88e HTTP/1.1 May 26 18:08:24.391375 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Accept: application/json May 26 18:08:24.391375 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Accept-Encoding: identity May 26 18:08:24.391375 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Connection: close May 26 18:08:24.391375 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Content-Length: 0 May 26 18:08:24.391375 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Content-Type: application/json May 26 18:08:24.391375 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Host: 10.222.0.69 May 26 18:08:24.391375 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Openstack-System-Scope: None May 26 18:08:24.391375 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: User-Agent: python-urllib3/1.26.9 May 26 18:08:24.391375 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Auth-Token: gAAAAABij8IN9cIjwADUIsl1q3y3-rNxLOMjbxk42lGJw5VeYBxcHRebqtRh3be_Hv85AJw6SKK95unnbc5fOpTDPgw6SvHJluyoPwl_If7aY5qXZGuQv0eFYH7d_qy4ASss2HD39vmX1UbzM7unGKOv6CpzaG1suW-tB-GzD2TOmHmKHJH-PQc May 26 18:08:24.391375 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Domain-Id: None May 26 18:08:24.391375 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Domain-Name: None May 26 18:08:24.391375 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Identity-Status: Confirmed May 26 18:08:24.391375 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Is-Admin-Project: True May 26 18:08:24.391375 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Domain-Id: default May 26 18:08:24.391375 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Domain-Name: Default May 26 18:08:24.391375 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Id: 2d8a7527f46d4e0d8d8fb538353a4ab1 May 26 18:08:24.391375 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2030019378 May 26 18:08:24.391375 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Role: member,reader May 26 18:08:24.391375 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Roles: member,reader May 26 18:08:24.392875 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2d8a7527f46d4e0d8d8fb538353a4ab1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/2d8a7527f46d4e0d8d8fb538353a4ab1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2d8a7527f46d4e0d8d8fb538353a4ab1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_2d8a7527f46d4e0d8d8fb538353a4ab1"}]}] May 26 18:08:24.392875 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2030019378 May 26 18:08:24.392875 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant-Id: 2d8a7527f46d4e0d8d8fb538353a4ab1 May 26 18:08:24.392875 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2030019378 May 26 18:08:24.392875 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User: tempest-VolumesSnapshotsTestJSON-2030019378-project May 26 18:08:24.392875 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Domain-Id: default May 26 18:08:24.392875 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Domain-Name: Default May 26 18:08:24.392875 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Id: b0acebd9631b4f2ca18c2463da2c7d03 May 26 18:08:24.392875 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2030019378-project May 26 18:08:24.392875 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: method: May 26 18:08:24.392875 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: exception: Volume eb1aafb7-2ee3-44b4-be41-a46e6461d88e could not be found. May 26 18:08:24.392875 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: action_args: {'id': 'eb1aafb7-2ee3-44b4-be41-a46e6461d88e'} May 26 18:08:24.392875 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:08:24.393753 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:24.393753 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 18:08:24.393753 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 18:08:24.393753 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 18:08:24.393753 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 18:08:24.393753 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 18:08:24.393753 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 18:08:24.393753 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 18:08:24.393753 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 18:08:24.393753 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 18:08:24.393753 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 18:08:24.393753 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 18:08:24.393753 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 18:08:24.393753 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 18:08:24.393753 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 18:08:24.393753 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume eb1aafb7-2ee3-44b4-be41-a46e6461d88e could not be found. (HTTP 404) (Request-ID: req-a4c6deb0-27c9-4f2f-84f2-cfa5613b455f) May 26 18:08:24.393753 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:24.393753 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:24.393753 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:24.395160 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:24.395160 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 18:08:24.395160 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 18:08:24.395160 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 18:08:24.395160 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 18:08:24.395160 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 18:08:24.395160 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 18:08:24.395160 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 18:08:24.395160 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 18:08:24.395160 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 18:08:24.395160 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 18:08:24.395160 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 18:08:24.395160 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 18:08:24.395160 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 18:08:24.395160 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 18:08:24.395160 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 18:08:24.395160 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 18:08:24.395160 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 18:08:24.395160 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 18:08:24.396457 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 18:08:24.396457 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 18:08:24.396457 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 18:08:24.396457 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 18:08:24.396457 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume eb1aafb7-2ee3-44b4-be41-a46e6461d88e could not be found. May 26 18:08:24.396457 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:24.396457 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:24.396457 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:24.396457 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:24.396457 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:08:24.396457 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:08:24.396457 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:08:24.396457 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:08:24.396457 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 18:08:24.396457 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 18:08:24.396457 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:08:24.396457 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:08:24.396457 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 18:08:24.396457 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:08:24.397581 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume eb1aafb7-2ee3-44b4-be41-a46e6461d88e could not be found. May 26 18:08:24.397581 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:24.397581 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:24.397581 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:24.397581 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:24.397581 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:08:24.397581 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:08:24.397581 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:08:24.397581 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:08:24.397581 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume eb1aafb7-2ee3-44b4-be41-a46e6461d88e could not be found. May 26 18:08:24.397581 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:24.397581 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-b508b95b-6b81-44f1-b67f-e041e6fce24e tempest-VolumesSnapshotsTestJSON-2030019378 tempest-VolumesSnapshotsTestJSON-2030019378-project] Returning 404 to user: Volume eb1aafb7-2ee3-44b4-be41-a46e6461d88e could not be found. {{(pid=117723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:08:24.397581 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-b508b95b-6b81-44f1-b67f-e041e6fce24e tempest-VolumesSnapshotsTestJSON-2030019378 tempest-VolumesSnapshotsTestJSON-2030019378-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/eb1aafb7-2ee3-44b4-be41-a46e6461d88e" status: 404 len: 109 microversion: 2.1 time: 0.040213 May 26 18:08:24.397581 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 441/911] 10.222.0.69 () {58 vars in 1244 bytes} [Thu May 26 18:08:24 2022] GET /compute/v2.1/os-volumes/eb1aafb7-2ee3-44b4-be41-a46e6461d88e => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:08:24.404536 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-3b326bed-adfc-43f5-a132-5b72d849f352 tempest-VolumesSnapshotsTestJSON-2030019378 tempest-VolumesSnapshotsTestJSON-2030019378-project] Calling method '.version_select at 0x7f3ab8cf35e0>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:24.433916 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.wsgi [None req-3b326bed-adfc-43f5-a132-5b72d849f352 tempest-VolumesSnapshotsTestJSON-2030019378 tempest-VolumesSnapshotsTestJSON-2030019378-project] HTTP exception thrown: Volume eb1aafb7-2ee3-44b4-be41-a46e6461d88e could not be found. May 26 18:08:24.436891 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-3b326bed-adfc-43f5-a132-5b72d849f352 tempest-VolumesSnapshotsTestJSON-2030019378 tempest-VolumesSnapshotsTestJSON-2030019378-project] Request method failure captured: May 26 18:08:24.436891 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: request: DELETE /compute/v2.1/os-volumes/eb1aafb7-2ee3-44b4-be41-a46e6461d88e HTTP/1.1 May 26 18:08:24.436891 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Accept: application/json May 26 18:08:24.436891 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Accept-Encoding: identity May 26 18:08:24.436891 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Connection: close May 26 18:08:24.436891 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Content-Length: 0 May 26 18:08:24.436891 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Content-Type: application/json May 26 18:08:24.436891 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Host: 10.222.0.69 May 26 18:08:24.436891 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Openstack-System-Scope: None May 26 18:08:24.436891 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: User-Agent: python-urllib3/1.26.9 May 26 18:08:24.436891 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Auth-Token: gAAAAABij8IN9cIjwADUIsl1q3y3-rNxLOMjbxk42lGJw5VeYBxcHRebqtRh3be_Hv85AJw6SKK95unnbc5fOpTDPgw6SvHJluyoPwl_If7aY5qXZGuQv0eFYH7d_qy4ASss2HD39vmX1UbzM7unGKOv6CpzaG1suW-tB-GzD2TOmHmKHJH-PQc May 26 18:08:24.436891 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Domain-Id: None May 26 18:08:24.436891 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Domain-Name: None May 26 18:08:24.436891 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Identity-Status: Confirmed May 26 18:08:24.436891 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Is-Admin-Project: True May 26 18:08:24.436891 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Domain-Id: default May 26 18:08:24.436891 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Domain-Name: Default May 26 18:08:24.436891 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Id: 2d8a7527f46d4e0d8d8fb538353a4ab1 May 26 18:08:24.436891 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2030019378 May 26 18:08:24.436891 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Role: member,reader May 26 18:08:24.436891 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Roles: member,reader May 26 18:08:24.438461 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2d8a7527f46d4e0d8d8fb538353a4ab1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/2d8a7527f46d4e0d8d8fb538353a4ab1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2d8a7527f46d4e0d8d8fb538353a4ab1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_2d8a7527f46d4e0d8d8fb538353a4ab1"}]}] May 26 18:08:24.438461 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2030019378 May 26 18:08:24.438461 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant-Id: 2d8a7527f46d4e0d8d8fb538353a4ab1 May 26 18:08:24.438461 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2030019378 May 26 18:08:24.438461 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User: tempest-VolumesSnapshotsTestJSON-2030019378-project May 26 18:08:24.438461 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Domain-Id: default May 26 18:08:24.438461 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Domain-Name: Default May 26 18:08:24.438461 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Id: b0acebd9631b4f2ca18c2463da2c7d03 May 26 18:08:24.438461 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2030019378-project May 26 18:08:24.438461 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: method: May 26 18:08:24.438461 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: exception: Volume eb1aafb7-2ee3-44b4-be41-a46e6461d88e could not be found. May 26 18:08:24.438461 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: action_args: {'id': 'eb1aafb7-2ee3-44b4-be41-a46e6461d88e'} May 26 18:08:24.438461 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:08:24.439441 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:24.439441 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 18:08:24.439441 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 18:08:24.439441 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 18:08:24.439441 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 18:08:24.439441 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 18:08:24.439441 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 18:08:24.439441 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 18:08:24.439441 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 18:08:24.439441 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 18:08:24.439441 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 18:08:24.439441 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 18:08:24.439441 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 18:08:24.439441 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 18:08:24.439441 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 18:08:24.439441 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume eb1aafb7-2ee3-44b4-be41-a46e6461d88e could not be found. (HTTP 404) (Request-ID: req-1a1974f5-d438-4882-8df9-c90f531ccfae) May 26 18:08:24.439441 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:08:24.439441 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:24.439441 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:08:24.440847 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:24.440847 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 26 18:08:24.440847 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 26 18:08:24.440847 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 18:08:24.440847 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 18:08:24.440847 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 18:08:24.440847 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 18:08:24.440847 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 18:08:24.440847 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 18:08:24.440847 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 18:08:24.440847 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 18:08:24.440847 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 18:08:24.440847 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 18:08:24.440847 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 18:08:24.440847 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 18:08:24.440847 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 18:08:24.440847 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 18:08:24.440847 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 18:08:24.440847 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 18:08:24.442161 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 18:08:24.442161 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 18:08:24.442161 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 18:08:24.442161 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 18:08:24.442161 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume eb1aafb7-2ee3-44b4-be41-a46e6461d88e could not be found. May 26 18:08:24.442161 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:08:24.442161 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:24.442161 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:08:24.442161 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:24.442161 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:08:24.442161 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:08:24.442161 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:08:24.442161 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:08:24.442161 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 18:08:24.442161 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 18:08:24.442161 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:08:24.442161 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:08:24.442161 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 26 18:08:24.442161 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:08:24.443507 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume eb1aafb7-2ee3-44b4-be41-a46e6461d88e could not be found. May 26 18:08:24.443507 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:08:24.443507 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:24.443507 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:08:24.443507 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:24.443507 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:08:24.443507 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:08:24.443507 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:08:24.443507 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:08:24.443507 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume eb1aafb7-2ee3-44b4-be41-a46e6461d88e could not be found. May 26 18:08:24.443507 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:08:24.443507 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-3b326bed-adfc-43f5-a132-5b72d849f352 tempest-VolumesSnapshotsTestJSON-2030019378 tempest-VolumesSnapshotsTestJSON-2030019378-project] Returning 404 to user: Volume eb1aafb7-2ee3-44b4-be41-a46e6461d88e could not be found. {{(pid=117722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:08:24.443507 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-3b326bed-adfc-43f5-a132-5b72d849f352 tempest-VolumesSnapshotsTestJSON-2030019378 tempest-VolumesSnapshotsTestJSON-2030019378-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/eb1aafb7-2ee3-44b4-be41-a46e6461d88e" status: 404 len: 109 microversion: 2.1 time: 0.038235 May 26 18:08:24.443507 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 471/912] 10.222.0.69 () {58 vars in 1247 bytes} [Thu May 26 18:08:24 2022] DELETE /compute/v2.1/os-volumes/eb1aafb7-2ee3-44b4-be41-a46e6461d88e => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:08:24.449554 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-d0d062c1-5cdb-4ad0-8ecd-900462ea9fad tempest-VolumesSnapshotsTestJSON-2030019378 tempest-VolumesSnapshotsTestJSON-2030019378-project] Calling method '.version_select at 0x7f3ab8afc940>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:24.480215 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.wsgi [None req-d0d062c1-5cdb-4ad0-8ecd-900462ea9fad tempest-VolumesSnapshotsTestJSON-2030019378 tempest-VolumesSnapshotsTestJSON-2030019378-project] HTTP exception thrown: Volume eb1aafb7-2ee3-44b4-be41-a46e6461d88e could not be found. May 26 18:08:24.482817 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-d0d062c1-5cdb-4ad0-8ecd-900462ea9fad tempest-VolumesSnapshotsTestJSON-2030019378 tempest-VolumesSnapshotsTestJSON-2030019378-project] Request method failure captured: May 26 18:08:24.482817 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: request: GET /compute/v2.1/os-volumes/eb1aafb7-2ee3-44b4-be41-a46e6461d88e HTTP/1.1 May 26 18:08:24.482817 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Accept: application/json May 26 18:08:24.482817 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Accept-Encoding: identity May 26 18:08:24.482817 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Connection: close May 26 18:08:24.482817 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Content-Length: 0 May 26 18:08:24.482817 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Content-Type: application/json May 26 18:08:24.482817 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Host: 10.222.0.69 May 26 18:08:24.482817 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Openstack-System-Scope: None May 26 18:08:24.482817 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: User-Agent: python-urllib3/1.26.9 May 26 18:08:24.482817 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Auth-Token: gAAAAABij8IN9cIjwADUIsl1q3y3-rNxLOMjbxk42lGJw5VeYBxcHRebqtRh3be_Hv85AJw6SKK95unnbc5fOpTDPgw6SvHJluyoPwl_If7aY5qXZGuQv0eFYH7d_qy4ASss2HD39vmX1UbzM7unGKOv6CpzaG1suW-tB-GzD2TOmHmKHJH-PQc May 26 18:08:24.482817 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Domain-Id: None May 26 18:08:24.482817 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Domain-Name: None May 26 18:08:24.482817 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Identity-Status: Confirmed May 26 18:08:24.482817 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Is-Admin-Project: True May 26 18:08:24.482817 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Domain-Id: default May 26 18:08:24.482817 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Domain-Name: Default May 26 18:08:24.482817 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Id: 2d8a7527f46d4e0d8d8fb538353a4ab1 May 26 18:08:24.482817 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2030019378 May 26 18:08:24.482817 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Role: member,reader May 26 18:08:24.482817 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Roles: member,reader May 26 18:08:24.484435 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2d8a7527f46d4e0d8d8fb538353a4ab1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/2d8a7527f46d4e0d8d8fb538353a4ab1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2d8a7527f46d4e0d8d8fb538353a4ab1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_2d8a7527f46d4e0d8d8fb538353a4ab1"}]}] May 26 18:08:24.484435 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2030019378 May 26 18:08:24.484435 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant-Id: 2d8a7527f46d4e0d8d8fb538353a4ab1 May 26 18:08:24.484435 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2030019378 May 26 18:08:24.484435 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User: tempest-VolumesSnapshotsTestJSON-2030019378-project May 26 18:08:24.484435 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Domain-Id: default May 26 18:08:24.484435 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Domain-Name: Default May 26 18:08:24.484435 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Id: b0acebd9631b4f2ca18c2463da2c7d03 May 26 18:08:24.484435 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2030019378-project May 26 18:08:24.484435 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: method: May 26 18:08:24.484435 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: exception: Volume eb1aafb7-2ee3-44b4-be41-a46e6461d88e could not be found. May 26 18:08:24.484435 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: action_args: {'id': 'eb1aafb7-2ee3-44b4-be41-a46e6461d88e'} May 26 18:08:24.484435 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:08:24.488441 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:24.488441 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 18:08:24.488441 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 18:08:24.488441 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 18:08:24.488441 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 18:08:24.488441 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 18:08:24.488441 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 18:08:24.488441 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 18:08:24.488441 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 18:08:24.488441 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 18:08:24.488441 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 18:08:24.488441 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 18:08:24.488441 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 18:08:24.488441 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 18:08:24.488441 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 18:08:24.488441 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume eb1aafb7-2ee3-44b4-be41-a46e6461d88e could not be found. (HTTP 404) (Request-ID: req-9ceebddb-5ff3-4647-a52f-3836954a78ab) May 26 18:08:24.488441 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:24.488441 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:24.488441 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:24.489725 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:24.489725 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 18:08:24.489725 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 18:08:24.489725 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 18:08:24.489725 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 18:08:24.489725 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 18:08:24.489725 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 18:08:24.489725 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 18:08:24.489725 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 18:08:24.489725 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 18:08:24.489725 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 18:08:24.489725 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 18:08:24.489725 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 18:08:24.489725 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 18:08:24.489725 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 18:08:24.489725 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 18:08:24.489725 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 18:08:24.489725 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 18:08:24.489725 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 18:08:24.491516 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 18:08:24.491516 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 18:08:24.491516 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 18:08:24.491516 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 18:08:24.491516 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume eb1aafb7-2ee3-44b4-be41-a46e6461d88e could not be found. May 26 18:08:24.491516 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:24.491516 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:24.491516 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:24.491516 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:24.491516 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:08:24.491516 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:08:24.491516 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:08:24.491516 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:08:24.491516 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 18:08:24.491516 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 18:08:24.491516 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:08:24.491516 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:08:24.491516 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 18:08:24.491516 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:08:24.492890 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume eb1aafb7-2ee3-44b4-be41-a46e6461d88e could not be found. May 26 18:08:24.492890 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:24.492890 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:24.492890 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:24.492890 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:24.492890 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:08:24.492890 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:08:24.492890 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:08:24.492890 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:08:24.492890 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume eb1aafb7-2ee3-44b4-be41-a46e6461d88e could not be found. May 26 18:08:24.492890 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:24.492890 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-d0d062c1-5cdb-4ad0-8ecd-900462ea9fad tempest-VolumesSnapshotsTestJSON-2030019378 tempest-VolumesSnapshotsTestJSON-2030019378-project] Returning 404 to user: Volume eb1aafb7-2ee3-44b4-be41-a46e6461d88e could not be found. {{(pid=117723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:08:24.492890 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-d0d062c1-5cdb-4ad0-8ecd-900462ea9fad tempest-VolumesSnapshotsTestJSON-2030019378 tempest-VolumesSnapshotsTestJSON-2030019378-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/eb1aafb7-2ee3-44b4-be41-a46e6461d88e" status: 404 len: 109 microversion: 2.1 time: 0.039133 May 26 18:08:24.492890 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 442/913] 10.222.0.69 () {58 vars in 1244 bytes} [Thu May 26 18:08:24 2022] GET /compute/v2.1/os-volumes/eb1aafb7-2ee3-44b4-be41-a46e6461d88e => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:08:24.711420 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-a6dfaf1a-4d66-450e-a33e-15411075f341 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:24.712464 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-a6dfaf1a-4d66-450e-a33e-15411075f341 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:24.725723 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-a6dfaf1a-4d66-450e-a33e-15411075f341 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:24.726523 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-a6dfaf1a-4d66-450e-a33e-15411075f341 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:24.727924 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-a6dfaf1a-4d66-450e-a33e-15411075f341 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:24.728678 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-a6dfaf1a-4d66-450e-a33e-15411075f341 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:24.891353 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-a6dfaf1a-4d66-450e-a33e-15411075f341 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:24.900304 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-a6dfaf1a-4d66-450e-a33e-15411075f341 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:24.901985 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-a6dfaf1a-4d66-450e-a33e-15411075f341 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:24.903613 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-a6dfaf1a-4d66-450e-a33e-15411075f341 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1715 microversion: 2.20 time: 0.199457 May 26 18:08:24.904280 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 472/914] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:08:24 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1715 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:08:26.128454 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-f46de58b-6800-4a6e-b2a6-a9edfdb55b79 tempest-VolumesNegativeTest-844957965 tempest-VolumesNegativeTest-844957965-project] Action: 'create', calling method: .version_select at 0x7f3abde3b1f0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1893207137", "metadata": {"Type": "work"}}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:08:26.143512 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-f46de58b-6800-4a6e-b2a6-a9edfdb55b79 tempest-VolumesNegativeTest-844957965 tempest-VolumesNegativeTest-844957965-project] Request method failure captured: May 26 18:08:26.143512 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 26 18:08:26.143512 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Accept: application/json May 26 18:08:26.143512 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Accept-Encoding: identity May 26 18:08:26.143512 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Connection: close May 26 18:08:26.143512 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Content-Length: 122 May 26 18:08:26.143512 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Content-Type: application/json May 26 18:08:26.143512 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Host: 10.222.0.69 May 26 18:08:26.143512 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Openstack-System-Scope: None May 26 18:08:26.143512 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: User-Agent: python-urllib3/1.26.9 May 26 18:08:26.143512 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Auth-Token: gAAAAABij8IZN1iPh1D9souJw6Avf1NZPDNJAVjwrEY-VXn3jiZOtHYwmTe1vipOW7z9GWKuWyd2SuiElqNe-4G8hyiMbRcekCXekpPMltLnZLG7uP86ueM9IEo6MsgnPQwJKJZ1zB2FMJ6d5TCwaIiiJ_WEPxVmUEMb9__GuO3M3A9EmPXY-_Q May 26 18:08:26.143512 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Domain-Id: None May 26 18:08:26.143512 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Domain-Name: None May 26 18:08:26.143512 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Identity-Status: Confirmed May 26 18:08:26.143512 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Is-Admin-Project: True May 26 18:08:26.143512 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Domain-Id: default May 26 18:08:26.143512 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Domain-Name: Default May 26 18:08:26.143512 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Id: a52b7beda16e4abfbf0914a52678ce5e May 26 18:08:26.143512 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Name: tempest-VolumesNegativeTest-844957965 May 26 18:08:26.143512 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Role: member,reader May 26 18:08:26.143512 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Roles: member,reader May 26 18:08:26.145279 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a52b7beda16e4abfbf0914a52678ce5e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/a52b7beda16e4abfbf0914a52678ce5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a52b7beda16e4abfbf0914a52678ce5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_a52b7beda16e4abfbf0914a52678ce5e"}]}] May 26 18:08:26.145279 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant: tempest-VolumesNegativeTest-844957965 May 26 18:08:26.145279 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant-Id: a52b7beda16e4abfbf0914a52678ce5e May 26 18:08:26.145279 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant-Name: tempest-VolumesNegativeTest-844957965 May 26 18:08:26.145279 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User: tempest-VolumesNegativeTest-844957965-project May 26 18:08:26.145279 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Domain-Id: default May 26 18:08:26.145279 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Domain-Name: Default May 26 18:08:26.145279 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Id: 1b73a7943c544e2394a20fd6fcb29aeb May 26 18:08:26.145279 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Name: tempest-VolumesNegativeTest-844957965-project May 26 18:08:26.145279 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: May 26 18:08:26.145279 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1893207137", "metadata": {"Type": "work"}}} May 26 18:08:26.145279 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: method: May 26 18:08:26.145279 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 26 18:08:26.146183 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1893207137', 'metadata': {'Type': 'work'}}}} May 26 18:08:26.146183 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:08:26.146183 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:26.146183 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 26 18:08:26.146183 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 26 18:08:26.146183 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 26 18:08:26.146183 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise error May 26 18:08:26.146183 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 26 18:08:26.146183 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:26.146183 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 26 18:08:26.146183 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 26 18:08:26.146183 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:26.146183 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi On instance['volume']: May 26 18:08:26.146183 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi '#$%' May 26 18:08:26.146183 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:26.146183 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:26.146183 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:26.146183 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:26.146183 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:08:26.146183 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:08:26.146183 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:08:26.146183 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:08:26.147604 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 18:08:26.147604 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 18:08:26.147604 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:08:26.147604 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:08:26.147604 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 26 18:08:26.147604 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 26 18:08:26.147604 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 26 18:08:26.147604 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 26 18:08:26.147604 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 26 18:08:26.147604 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 26 18:08:26.147604 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 26 18:08:26.147604 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:26.147604 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:26.147604 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:26.147604 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:26.147604 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:08:26.147604 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:08:26.147604 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 26 18:08:26.147604 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 26 18:08:26.148787 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 26 18:08:26.148787 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:26.148787 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-f46de58b-6800-4a6e-b2a6-a9edfdb55b79 tempest-VolumesNegativeTest-844957965 tempest-VolumesNegativeTest-844957965-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:08:26.148787 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-f46de58b-6800-4a6e-b2a6-a9edfdb55b79 tempest-VolumesNegativeTest-844957965 tempest-VolumesNegativeTest-844957965-project] 10.222.0.69 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.143874 May 26 18:08:26.148787 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 443/915] 10.222.0.69 () {60 vars in 1155 bytes} [Thu May 26 18:08:25 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 145 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 18:08:26.156143 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-603f4e98-b828-4a9a-9bd9-d0358bf3571c tempest-VolumesNegativeTest-844957965 tempest-VolumesNegativeTest-844957965-project] Action: 'create', calling method: .version_select at 0x7f3ab8cf30d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-858476709", "metadata": {"Type": "work"}}} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:08:26.159509 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-603f4e98-b828-4a9a-9bd9-d0358bf3571c tempest-VolumesNegativeTest-844957965 tempest-VolumesNegativeTest-844957965-project] Request method failure captured: May 26 18:08:26.159509 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 26 18:08:26.159509 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Accept: application/json May 26 18:08:26.159509 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Accept-Encoding: identity May 26 18:08:26.159509 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Connection: close May 26 18:08:26.159509 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Content-Length: 119 May 26 18:08:26.159509 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Content-Type: application/json May 26 18:08:26.159509 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Host: 10.222.0.69 May 26 18:08:26.159509 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Openstack-System-Scope: None May 26 18:08:26.159509 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: User-Agent: python-urllib3/1.26.9 May 26 18:08:26.159509 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Auth-Token: gAAAAABij8IZN1iPh1D9souJw6Avf1NZPDNJAVjwrEY-VXn3jiZOtHYwmTe1vipOW7z9GWKuWyd2SuiElqNe-4G8hyiMbRcekCXekpPMltLnZLG7uP86ueM9IEo6MsgnPQwJKJZ1zB2FMJ6d5TCwaIiiJ_WEPxVmUEMb9__GuO3M3A9EmPXY-_Q May 26 18:08:26.159509 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Domain-Id: None May 26 18:08:26.159509 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Domain-Name: None May 26 18:08:26.159509 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Identity-Status: Confirmed May 26 18:08:26.159509 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Is-Admin-Project: True May 26 18:08:26.159509 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Domain-Id: default May 26 18:08:26.159509 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Domain-Name: Default May 26 18:08:26.159509 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Id: a52b7beda16e4abfbf0914a52678ce5e May 26 18:08:26.159509 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Name: tempest-VolumesNegativeTest-844957965 May 26 18:08:26.159509 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Role: member,reader May 26 18:08:26.159509 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Roles: member,reader May 26 18:08:26.161466 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a52b7beda16e4abfbf0914a52678ce5e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/a52b7beda16e4abfbf0914a52678ce5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a52b7beda16e4abfbf0914a52678ce5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_a52b7beda16e4abfbf0914a52678ce5e"}]}] May 26 18:08:26.161466 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant: tempest-VolumesNegativeTest-844957965 May 26 18:08:26.161466 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant-Id: a52b7beda16e4abfbf0914a52678ce5e May 26 18:08:26.161466 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant-Name: tempest-VolumesNegativeTest-844957965 May 26 18:08:26.161466 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User: tempest-VolumesNegativeTest-844957965-project May 26 18:08:26.161466 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Domain-Id: default May 26 18:08:26.161466 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Domain-Name: Default May 26 18:08:26.161466 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Id: 1b73a7943c544e2394a20fd6fcb29aeb May 26 18:08:26.161466 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Name: tempest-VolumesNegativeTest-844957965-project May 26 18:08:26.161466 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: May 26 18:08:26.161466 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-858476709", "metadata": {"Type": "work"}}} May 26 18:08:26.161466 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: method: May 26 18:08:26.161466 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 26 18:08:26.162401 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-858476709', 'metadata': {'Type': 'work'}}}} May 26 18:08:26.162401 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:08:26.162401 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:26.162401 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 26 18:08:26.162401 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 26 18:08:26.162401 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 26 18:08:26.162401 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise error May 26 18:08:26.162401 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 26 18:08:26.162401 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:08:26.162401 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 26 18:08:26.162401 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 26 18:08:26.162401 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:08:26.162401 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi On instance['volume']: May 26 18:08:26.162401 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi '0' May 26 18:08:26.162401 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:08:26.162401 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:26.162401 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:08:26.162401 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:26.162401 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:08:26.162401 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:08:26.162401 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:08:26.162401 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:08:26.163942 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 18:08:26.163942 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 18:08:26.163942 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:08:26.163942 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:08:26.163942 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 26 18:08:26.163942 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 26 18:08:26.163942 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 26 18:08:26.163942 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 26 18:08:26.163942 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 26 18:08:26.163942 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 26 18:08:26.163942 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 26 18:08:26.163942 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:08:26.163942 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:26.163942 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:08:26.163942 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:26.163942 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:08:26.163942 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:08:26.163942 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 26 18:08:26.163942 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 26 18:08:26.165388 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 26 18:08:26.165388 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:08:26.165388 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-603f4e98-b828-4a9a-9bd9-d0358bf3571c tempest-VolumesNegativeTest-844957965 tempest-VolumesNegativeTest-844957965-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:08:26.165388 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-603f4e98-b828-4a9a-9bd9-d0358bf3571c tempest-VolumesNegativeTest-844957965 tempest-VolumesNegativeTest-844957965-project] 10.222.0.69 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009826 May 26 18:08:26.165388 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 473/916] 10.222.0.69 () {60 vars in 1155 bytes} [Thu May 26 18:08:26 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 18:08:26.171655 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-0ff48e25-062b-487c-8bf2-994ec2e2aef4 tempest-VolumesNegativeTest-844957965 tempest-VolumesNegativeTest-844957965-project] Action: 'create', calling method: .version_select at 0x7f3ab8b51280>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-929169133", "metadata": {"Type": "work"}}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:08:26.174017 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-0ff48e25-062b-487c-8bf2-994ec2e2aef4 tempest-VolumesNegativeTest-844957965 tempest-VolumesNegativeTest-844957965-project] Request method failure captured: May 26 18:08:26.174017 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 26 18:08:26.174017 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Accept: application/json May 26 18:08:26.174017 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Accept-Encoding: identity May 26 18:08:26.174017 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Connection: close May 26 18:08:26.174017 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Content-Length: 118 May 26 18:08:26.174017 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Content-Type: application/json May 26 18:08:26.174017 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Host: 10.222.0.69 May 26 18:08:26.174017 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Openstack-System-Scope: None May 26 18:08:26.174017 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: User-Agent: python-urllib3/1.26.9 May 26 18:08:26.174017 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Auth-Token: gAAAAABij8IZN1iPh1D9souJw6Avf1NZPDNJAVjwrEY-VXn3jiZOtHYwmTe1vipOW7z9GWKuWyd2SuiElqNe-4G8hyiMbRcekCXekpPMltLnZLG7uP86ueM9IEo6MsgnPQwJKJZ1zB2FMJ6d5TCwaIiiJ_WEPxVmUEMb9__GuO3M3A9EmPXY-_Q May 26 18:08:26.174017 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Domain-Id: None May 26 18:08:26.174017 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Domain-Name: None May 26 18:08:26.174017 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Identity-Status: Confirmed May 26 18:08:26.174017 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Is-Admin-Project: True May 26 18:08:26.174017 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Domain-Id: default May 26 18:08:26.174017 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Domain-Name: Default May 26 18:08:26.174017 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Id: a52b7beda16e4abfbf0914a52678ce5e May 26 18:08:26.174017 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Name: tempest-VolumesNegativeTest-844957965 May 26 18:08:26.174017 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Role: member,reader May 26 18:08:26.174017 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Roles: member,reader May 26 18:08:26.175529 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a52b7beda16e4abfbf0914a52678ce5e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/a52b7beda16e4abfbf0914a52678ce5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a52b7beda16e4abfbf0914a52678ce5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_a52b7beda16e4abfbf0914a52678ce5e"}]}] May 26 18:08:26.175529 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant: tempest-VolumesNegativeTest-844957965 May 26 18:08:26.175529 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant-Id: a52b7beda16e4abfbf0914a52678ce5e May 26 18:08:26.175529 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant-Name: tempest-VolumesNegativeTest-844957965 May 26 18:08:26.175529 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User: tempest-VolumesNegativeTest-844957965-project May 26 18:08:26.175529 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Domain-Id: default May 26 18:08:26.175529 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Domain-Name: Default May 26 18:08:26.175529 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Id: 1b73a7943c544e2394a20fd6fcb29aeb May 26 18:08:26.175529 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Name: tempest-VolumesNegativeTest-844957965-project May 26 18:08:26.175529 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: May 26 18:08:26.175529 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-929169133", "metadata": {"Type": "work"}}} May 26 18:08:26.175529 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: method: May 26 18:08:26.175529 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 26 18:08:26.176541 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-929169133', 'metadata': {'Type': 'work'}}}} May 26 18:08:26.176541 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:08:26.176541 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:26.176541 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 26 18:08:26.176541 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 26 18:08:26.176541 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 26 18:08:26.176541 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise error May 26 18:08:26.176541 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 26 18:08:26.176541 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:26.176541 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 26 18:08:26.176541 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 26 18:08:26.176541 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:26.176541 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi On instance['volume']: May 26 18:08:26.176541 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi '' May 26 18:08:26.176541 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:26.176541 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:26.176541 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:26.176541 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:26.176541 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:08:26.176541 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:08:26.176541 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:08:26.176541 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:08:26.178149 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 18:08:26.178149 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 18:08:26.178149 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:08:26.178149 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:08:26.178149 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 26 18:08:26.178149 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 26 18:08:26.178149 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 26 18:08:26.178149 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 26 18:08:26.178149 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 26 18:08:26.178149 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 26 18:08:26.178149 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 26 18:08:26.178149 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:26.178149 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:26.178149 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:26.178149 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:26.178149 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:08:26.178149 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:08:26.178149 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 26 18:08:26.178149 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 26 18:08:26.179488 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 26 18:08:26.179488 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:26.179488 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-0ff48e25-062b-487c-8bf2-994ec2e2aef4 tempest-VolumesNegativeTest-844957965 tempest-VolumesNegativeTest-844957965-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:08:26.179488 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-0ff48e25-062b-487c-8bf2-994ec2e2aef4 tempest-VolumesNegativeTest-844957965 tempest-VolumesNegativeTest-844957965-project] 10.222.0.69 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007765 May 26 18:08:26.179946 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 444/917] 10.222.0.69 () {60 vars in 1155 bytes} [Thu May 26 18:08:26 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 18:08:26.185596 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-8a9174d2-4d0a-4a93-8a9b-37b5238b731e tempest-VolumesNegativeTest-844957965 tempest-VolumesNegativeTest-844957965-project] Calling method '.version_select at 0x7f3ab8a69550>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:26.223703 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.wsgi [None req-8a9174d2-4d0a-4a93-8a9b-37b5238b731e tempest-VolumesNegativeTest-844957965 tempest-VolumesNegativeTest-844957965-project] HTTP exception thrown: Volume tempest-invalid-1963865590 could not be found. May 26 18:08:26.225728 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-8a9174d2-4d0a-4a93-8a9b-37b5238b731e tempest-VolumesNegativeTest-844957965 tempest-VolumesNegativeTest-844957965-project] Request method failure captured: May 26 18:08:26.225728 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1963865590 HTTP/1.1 May 26 18:08:26.225728 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Accept: application/json May 26 18:08:26.225728 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Accept-Encoding: identity May 26 18:08:26.225728 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Connection: close May 26 18:08:26.225728 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Content-Length: 0 May 26 18:08:26.225728 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Content-Type: application/json May 26 18:08:26.225728 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Host: 10.222.0.69 May 26 18:08:26.225728 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Openstack-System-Scope: None May 26 18:08:26.225728 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: User-Agent: python-urllib3/1.26.9 May 26 18:08:26.225728 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Auth-Token: gAAAAABij8IZN1iPh1D9souJw6Avf1NZPDNJAVjwrEY-VXn3jiZOtHYwmTe1vipOW7z9GWKuWyd2SuiElqNe-4G8hyiMbRcekCXekpPMltLnZLG7uP86ueM9IEo6MsgnPQwJKJZ1zB2FMJ6d5TCwaIiiJ_WEPxVmUEMb9__GuO3M3A9EmPXY-_Q May 26 18:08:26.225728 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Domain-Id: None May 26 18:08:26.225728 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Domain-Name: None May 26 18:08:26.225728 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Identity-Status: Confirmed May 26 18:08:26.225728 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Is-Admin-Project: True May 26 18:08:26.225728 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Domain-Id: default May 26 18:08:26.225728 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Domain-Name: Default May 26 18:08:26.225728 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Id: a52b7beda16e4abfbf0914a52678ce5e May 26 18:08:26.225728 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Name: tempest-VolumesNegativeTest-844957965 May 26 18:08:26.225728 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Role: member,reader May 26 18:08:26.225728 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Roles: member,reader May 26 18:08:26.227270 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a52b7beda16e4abfbf0914a52678ce5e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/a52b7beda16e4abfbf0914a52678ce5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a52b7beda16e4abfbf0914a52678ce5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_a52b7beda16e4abfbf0914a52678ce5e"}]}] May 26 18:08:26.227270 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant: tempest-VolumesNegativeTest-844957965 May 26 18:08:26.227270 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant-Id: a52b7beda16e4abfbf0914a52678ce5e May 26 18:08:26.227270 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant-Name: tempest-VolumesNegativeTest-844957965 May 26 18:08:26.227270 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User: tempest-VolumesNegativeTest-844957965-project May 26 18:08:26.227270 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Domain-Id: default May 26 18:08:26.227270 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Domain-Name: Default May 26 18:08:26.227270 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Id: 1b73a7943c544e2394a20fd6fcb29aeb May 26 18:08:26.227270 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Name: tempest-VolumesNegativeTest-844957965-project May 26 18:08:26.227270 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: method: May 26 18:08:26.227270 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: exception: Volume tempest-invalid-1963865590 could not be found. May 26 18:08:26.227270 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: action_args: {'id': 'tempest-invalid-1963865590'} May 26 18:08:26.227270 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:08:26.228244 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:26.228244 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 18:08:26.228244 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 18:08:26.228244 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 18:08:26.228244 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 18:08:26.228244 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 18:08:26.228244 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 18:08:26.228244 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 18:08:26.228244 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 18:08:26.228244 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 18:08:26.228244 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 18:08:26.228244 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 18:08:26.228244 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 18:08:26.228244 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 18:08:26.228244 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 18:08:26.228244 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1963865590 could not be found. (HTTP 404) (Request-ID: req-f99909e2-a8d6-4afd-992f-06ac19b9b6f7) May 26 18:08:26.228244 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:08:26.228244 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:26.228244 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:08:26.229595 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:26.229595 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 26 18:08:26.229595 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 26 18:08:26.229595 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 18:08:26.229595 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 18:08:26.229595 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 18:08:26.229595 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 18:08:26.229595 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 18:08:26.229595 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 18:08:26.229595 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 18:08:26.229595 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 18:08:26.229595 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 18:08:26.229595 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 18:08:26.229595 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 18:08:26.229595 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 18:08:26.229595 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 18:08:26.229595 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 18:08:26.229595 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 18:08:26.229595 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 18:08:26.230926 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 18:08:26.230926 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 18:08:26.230926 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 18:08:26.230926 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 18:08:26.230926 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1963865590 could not be found. May 26 18:08:26.230926 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:08:26.230926 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:26.230926 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:08:26.230926 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:26.230926 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:08:26.230926 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:08:26.230926 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:08:26.230926 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:08:26.230926 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 18:08:26.230926 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 18:08:26.230926 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:08:26.230926 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:08:26.230926 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 26 18:08:26.230926 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:08:26.230926 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1963865590 could not be found. May 26 18:08:26.232281 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:08:26.232281 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:26.232281 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:08:26.232281 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:26.232281 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:08:26.232281 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:08:26.232281 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:08:26.232281 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:08:26.232281 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1963865590 could not be found. May 26 18:08:26.232281 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:08:26.232281 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-8a9174d2-4d0a-4a93-8a9b-37b5238b731e tempest-VolumesNegativeTest-844957965 tempest-VolumesNegativeTest-844957965-project] Returning 404 to user: Volume tempest-invalid-1963865590 could not be found. {{(pid=117722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:08:26.232281 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-8a9174d2-4d0a-4a93-8a9b-37b5238b731e tempest-VolumesNegativeTest-844957965 tempest-VolumesNegativeTest-844957965-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1963865590" status: 404 len: 99 microversion: 2.1 time: 0.045894 May 26 18:08:26.232281 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 474/918] 10.222.0.69 () {58 vars in 1217 bytes} [Thu May 26 18:08:26 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1963865590 => generated 99 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 26 18:08:26.238198 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-47f1a069-384b-4770-8beb-77463b5982b9 tempest-VolumesNegativeTest-844957965 tempest-VolumesNegativeTest-844957965-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003767 May 26 18:08:26.238730 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 445/919] 10.222.0.69 () {58 vars in 1139 bytes} [Thu May 26 18:08:26 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 26 18:08:26.247321 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-e61dfe70-1bd4-4e9f-8f02-fcab61437c8a tempest-VolumesNegativeTest-844957965 tempest-VolumesNegativeTest-844957965-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003732 May 26 18:08:26.247833 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 475/920] 10.222.0.69 () {58 vars in 1136 bytes} [Thu May 26 18:08:26 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 26 18:08:26.257604 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-03cdf525-0927-4f40-b102-58f1c96b7716 tempest-VolumesNegativeTest-844957965 tempest-VolumesNegativeTest-844957965-project] Calling method '.version_select at 0x7f3ab8afe3a0>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:26.289927 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.wsgi [None req-03cdf525-0927-4f40-b102-58f1c96b7716 tempest-VolumesNegativeTest-844957965 tempest-VolumesNegativeTest-844957965-project] HTTP exception thrown: Volume 1e9c8947-ef4c-437c-b725-be364a63b33e could not be found. May 26 18:08:26.291874 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-03cdf525-0927-4f40-b102-58f1c96b7716 tempest-VolumesNegativeTest-844957965 tempest-VolumesNegativeTest-844957965-project] Request method failure captured: May 26 18:08:26.291874 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: request: DELETE /compute/v2.1/os-volumes/1e9c8947-ef4c-437c-b725-be364a63b33e HTTP/1.1 May 26 18:08:26.291874 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Accept: application/json May 26 18:08:26.291874 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Accept-Encoding: identity May 26 18:08:26.291874 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Connection: close May 26 18:08:26.291874 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Content-Length: 0 May 26 18:08:26.291874 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Content-Type: application/json May 26 18:08:26.291874 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Host: 10.222.0.69 May 26 18:08:26.291874 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Openstack-System-Scope: None May 26 18:08:26.291874 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: User-Agent: python-urllib3/1.26.9 May 26 18:08:26.291874 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Auth-Token: gAAAAABij8IZN1iPh1D9souJw6Avf1NZPDNJAVjwrEY-VXn3jiZOtHYwmTe1vipOW7z9GWKuWyd2SuiElqNe-4G8hyiMbRcekCXekpPMltLnZLG7uP86ueM9IEo6MsgnPQwJKJZ1zB2FMJ6d5TCwaIiiJ_WEPxVmUEMb9__GuO3M3A9EmPXY-_Q May 26 18:08:26.291874 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Domain-Id: None May 26 18:08:26.291874 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Domain-Name: None May 26 18:08:26.291874 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Identity-Status: Confirmed May 26 18:08:26.291874 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Is-Admin-Project: True May 26 18:08:26.291874 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Domain-Id: default May 26 18:08:26.291874 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Domain-Name: Default May 26 18:08:26.291874 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Id: a52b7beda16e4abfbf0914a52678ce5e May 26 18:08:26.291874 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Name: tempest-VolumesNegativeTest-844957965 May 26 18:08:26.291874 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Role: member,reader May 26 18:08:26.291874 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Roles: member,reader May 26 18:08:26.293438 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a52b7beda16e4abfbf0914a52678ce5e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/a52b7beda16e4abfbf0914a52678ce5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a52b7beda16e4abfbf0914a52678ce5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_a52b7beda16e4abfbf0914a52678ce5e"}]}] May 26 18:08:26.293438 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant: tempest-VolumesNegativeTest-844957965 May 26 18:08:26.293438 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant-Id: a52b7beda16e4abfbf0914a52678ce5e May 26 18:08:26.293438 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant-Name: tempest-VolumesNegativeTest-844957965 May 26 18:08:26.293438 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User: tempest-VolumesNegativeTest-844957965-project May 26 18:08:26.293438 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Domain-Id: default May 26 18:08:26.293438 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Domain-Name: Default May 26 18:08:26.293438 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Id: 1b73a7943c544e2394a20fd6fcb29aeb May 26 18:08:26.293438 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Name: tempest-VolumesNegativeTest-844957965-project May 26 18:08:26.293438 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: method: May 26 18:08:26.293438 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: exception: Volume 1e9c8947-ef4c-437c-b725-be364a63b33e could not be found. May 26 18:08:26.293438 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: action_args: {'id': '1e9c8947-ef4c-437c-b725-be364a63b33e'} May 26 18:08:26.293438 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:08:26.294577 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:26.294577 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 18:08:26.294577 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 18:08:26.294577 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 18:08:26.294577 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 18:08:26.294577 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 18:08:26.294577 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 18:08:26.294577 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 18:08:26.294577 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 18:08:26.294577 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 18:08:26.294577 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 18:08:26.294577 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 18:08:26.294577 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 18:08:26.294577 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 18:08:26.294577 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 18:08:26.294577 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1e9c8947-ef4c-437c-b725-be364a63b33e could not be found. (HTTP 404) (Request-ID: req-cbd475af-595a-4540-a201-010a83acf568) May 26 18:08:26.294577 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:26.294577 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:26.294577 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:26.295987 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:26.295987 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 26 18:08:26.295987 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 26 18:08:26.295987 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 18:08:26.295987 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 18:08:26.295987 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 18:08:26.295987 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 18:08:26.295987 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 18:08:26.295987 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 18:08:26.295987 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 18:08:26.295987 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 18:08:26.295987 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 18:08:26.295987 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 18:08:26.295987 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 18:08:26.295987 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 18:08:26.295987 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 18:08:26.295987 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 18:08:26.295987 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 18:08:26.295987 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 18:08:26.297426 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 18:08:26.297426 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 18:08:26.297426 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 18:08:26.297426 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 18:08:26.297426 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1e9c8947-ef4c-437c-b725-be364a63b33e could not be found. May 26 18:08:26.297426 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:26.297426 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:26.297426 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:26.297426 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:26.297426 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:08:26.297426 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:08:26.297426 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:08:26.297426 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:08:26.297426 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 18:08:26.297426 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 18:08:26.297426 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:08:26.297426 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:08:26.297426 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 26 18:08:26.297426 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:08:26.298882 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1e9c8947-ef4c-437c-b725-be364a63b33e could not be found. May 26 18:08:26.298882 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:26.298882 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:26.298882 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:26.298882 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:26.298882 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:08:26.298882 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:08:26.298882 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:08:26.298882 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:08:26.298882 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1e9c8947-ef4c-437c-b725-be364a63b33e could not be found. May 26 18:08:26.298882 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:26.298882 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-03cdf525-0927-4f40-b102-58f1c96b7716 tempest-VolumesNegativeTest-844957965 tempest-VolumesNegativeTest-844957965-project] Returning 404 to user: Volume 1e9c8947-ef4c-437c-b725-be364a63b33e could not be found. {{(pid=117723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:08:26.298882 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-03cdf525-0927-4f40-b102-58f1c96b7716 tempest-VolumesNegativeTest-844957965 tempest-VolumesNegativeTest-844957965-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/1e9c8947-ef4c-437c-b725-be364a63b33e" status: 404 len: 109 microversion: 2.1 time: 0.040401 May 26 18:08:26.298882 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 446/921] 10.222.0.69 () {58 vars in 1247 bytes} [Thu May 26 18:08:26 2022] DELETE /compute/v2.1/os-volumes/1e9c8947-ef4c-437c-b725-be364a63b33e => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:08:26.303364 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-f666a493-22a9-43e7-a4dd-b80271629020 tempest-VolumesNegativeTest-844957965 tempest-VolumesNegativeTest-844957965-project] Calling method '.version_select at 0x7f3ab8cf3040>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:26.331361 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.wsgi [None req-f666a493-22a9-43e7-a4dd-b80271629020 tempest-VolumesNegativeTest-844957965 tempest-VolumesNegativeTest-844957965-project] HTTP exception thrown: Volume 93f57aa5-612d-46fc-a648-d2d48970d24d could not be found. May 26 18:08:26.333401 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-f666a493-22a9-43e7-a4dd-b80271629020 tempest-VolumesNegativeTest-844957965 tempest-VolumesNegativeTest-844957965-project] Request method failure captured: May 26 18:08:26.333401 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: request: GET /compute/v2.1/os-volumes/93f57aa5-612d-46fc-a648-d2d48970d24d HTTP/1.1 May 26 18:08:26.333401 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Accept: application/json May 26 18:08:26.333401 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Accept-Encoding: identity May 26 18:08:26.333401 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Connection: close May 26 18:08:26.333401 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Content-Length: 0 May 26 18:08:26.333401 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Content-Type: application/json May 26 18:08:26.333401 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Host: 10.222.0.69 May 26 18:08:26.333401 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Openstack-System-Scope: None May 26 18:08:26.333401 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: User-Agent: python-urllib3/1.26.9 May 26 18:08:26.333401 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Auth-Token: gAAAAABij8IZN1iPh1D9souJw6Avf1NZPDNJAVjwrEY-VXn3jiZOtHYwmTe1vipOW7z9GWKuWyd2SuiElqNe-4G8hyiMbRcekCXekpPMltLnZLG7uP86ueM9IEo6MsgnPQwJKJZ1zB2FMJ6d5TCwaIiiJ_WEPxVmUEMb9__GuO3M3A9EmPXY-_Q May 26 18:08:26.333401 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Domain-Id: None May 26 18:08:26.333401 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Domain-Name: None May 26 18:08:26.333401 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Identity-Status: Confirmed May 26 18:08:26.333401 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Is-Admin-Project: True May 26 18:08:26.333401 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Domain-Id: default May 26 18:08:26.333401 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Domain-Name: Default May 26 18:08:26.333401 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Id: a52b7beda16e4abfbf0914a52678ce5e May 26 18:08:26.333401 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Name: tempest-VolumesNegativeTest-844957965 May 26 18:08:26.333401 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Role: member,reader May 26 18:08:26.333401 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Roles: member,reader May 26 18:08:26.335069 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a52b7beda16e4abfbf0914a52678ce5e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/a52b7beda16e4abfbf0914a52678ce5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a52b7beda16e4abfbf0914a52678ce5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_a52b7beda16e4abfbf0914a52678ce5e"}]}] May 26 18:08:26.335069 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant: tempest-VolumesNegativeTest-844957965 May 26 18:08:26.335069 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant-Id: a52b7beda16e4abfbf0914a52678ce5e May 26 18:08:26.335069 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant-Name: tempest-VolumesNegativeTest-844957965 May 26 18:08:26.335069 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User: tempest-VolumesNegativeTest-844957965-project May 26 18:08:26.335069 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Domain-Id: default May 26 18:08:26.335069 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Domain-Name: Default May 26 18:08:26.335069 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Id: 1b73a7943c544e2394a20fd6fcb29aeb May 26 18:08:26.335069 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Name: tempest-VolumesNegativeTest-844957965-project May 26 18:08:26.335069 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: method: May 26 18:08:26.335069 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: exception: Volume 93f57aa5-612d-46fc-a648-d2d48970d24d could not be found. May 26 18:08:26.335069 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: action_args: {'id': '93f57aa5-612d-46fc-a648-d2d48970d24d'} May 26 18:08:26.335069 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:08:26.336084 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:26.336084 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 18:08:26.336084 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 18:08:26.336084 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 18:08:26.336084 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 18:08:26.336084 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 18:08:26.336084 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 18:08:26.336084 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 18:08:26.336084 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 18:08:26.336084 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 18:08:26.336084 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 18:08:26.336084 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 18:08:26.336084 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 18:08:26.336084 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 18:08:26.336084 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 18:08:26.336084 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 93f57aa5-612d-46fc-a648-d2d48970d24d could not be found. (HTTP 404) (Request-ID: req-01510325-bbdc-4df2-a791-9bb2dd9fc85c) May 26 18:08:26.336084 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:08:26.336084 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:26.336084 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:08:26.337489 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:26.337489 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 18:08:26.337489 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 18:08:26.337489 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 18:08:26.337489 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 18:08:26.337489 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 18:08:26.337489 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 18:08:26.337489 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 18:08:26.337489 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 18:08:26.337489 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 18:08:26.337489 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 18:08:26.337489 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 18:08:26.337489 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 18:08:26.337489 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 18:08:26.337489 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 18:08:26.337489 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 18:08:26.337489 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 18:08:26.337489 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 18:08:26.337489 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 18:08:26.338909 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 18:08:26.338909 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 18:08:26.338909 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 18:08:26.338909 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 18:08:26.338909 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 93f57aa5-612d-46fc-a648-d2d48970d24d could not be found. May 26 18:08:26.338909 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:08:26.338909 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:26.338909 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:08:26.338909 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:26.338909 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:08:26.338909 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:08:26.338909 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:08:26.338909 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:08:26.338909 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 18:08:26.338909 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 18:08:26.338909 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:08:26.338909 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:08:26.338909 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 18:08:26.338909 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:08:26.340302 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 93f57aa5-612d-46fc-a648-d2d48970d24d could not be found. May 26 18:08:26.340302 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:08:26.340302 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:26.340302 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:08:26.340302 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:26.340302 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:08:26.340302 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:08:26.340302 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:08:26.340302 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:08:26.340302 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 93f57aa5-612d-46fc-a648-d2d48970d24d could not be found. May 26 18:08:26.340302 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:08:26.340302 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-f666a493-22a9-43e7-a4dd-b80271629020 tempest-VolumesNegativeTest-844957965 tempest-VolumesNegativeTest-844957965-project] Returning 404 to user: Volume 93f57aa5-612d-46fc-a648-d2d48970d24d could not be found. {{(pid=117722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:08:26.340302 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-f666a493-22a9-43e7-a4dd-b80271629020 tempest-VolumesNegativeTest-844957965 tempest-VolumesNegativeTest-844957965-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/93f57aa5-612d-46fc-a648-d2d48970d24d" status: 404 len: 109 microversion: 2.1 time: 0.035339 May 26 18:08:26.340302 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 476/922] 10.222.0.69 () {58 vars in 1244 bytes} [Thu May 26 18:08:26 2022] GET /compute/v2.1/os-volumes/93f57aa5-612d-46fc-a648-d2d48970d24d => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:08:33.352270 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_api:SELECT=3 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:33.353385 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=17 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:33.359933 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-309b0e68-c401-4b03-ac78-618f056599dc tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:33.360468 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-309b0e68-c401-4b03-ac78-618f056599dc tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 99ba7c81-2ccc-489b-b4d7-166ea0d3772f] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:33.371971 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-309b0e68-c401-4b03-ac78-618f056599dc tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:33.371971 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-309b0e68-c401-4b03-ac78-618f056599dc tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:33.371971 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-309b0e68-c401-4b03-ac78-618f056599dc tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:33.371971 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-309b0e68-c401-4b03-ac78-618f056599dc tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:33.395811 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-309b0e68-c401-4b03-ac78-618f056599dc tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/99ba7c81-2ccc-489b-b4d7-166ea0d3772f/ips" status: 200 len: 150 microversion: 2.1 time: 0.045417 May 26 18:08:33.400117 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 447/923] 10.222.0.69 () {58 vars in 1247 bytes} [Thu May 26 18:08:33 2022] GET /compute/v2.1/servers/99ba7c81-2ccc-489b-b4d7-166ea0d3772f/ips => generated 150 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:08:34.776925 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_api:SELECT=7 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:34.782622 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-68b987a5-08b4-47d4-b753-bbf42bcacec0 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b67e62a7-281b-40c1-909e-5f0dee3688f6"}} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:08:34.783734 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-68b987a5-08b4-47d4-b753-bbf42bcacec0 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 99ba7c81-2ccc-489b-b4d7-166ea0d3772f] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:34.790452 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-68b987a5-08b4-47d4-b753-bbf42bcacec0 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:34.790898 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-68b987a5-08b4-47d4-b753-bbf42bcacec0 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:34.791674 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-68b987a5-08b4-47d4-b753-bbf42bcacec0 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:34.792137 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-68b987a5-08b4-47d4-b753-bbf42bcacec0 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:35.055917 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-68b987a5-08b4-47d4-b753-bbf42bcacec0 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "POST /compute/v2.1/servers/99ba7c81-2ccc-489b-b4d7-166ea0d3772f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280161 May 26 18:08:35.056709 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 477/924] 10.222.0.69 () {60 vars in 1322 bytes} [Thu May 26 18:08:34 2022] POST /compute/v2.1/servers/99ba7c81-2ccc-489b-b4d7-166ea0d3772f/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:08:36.089246 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-4cdded41-a370-47af-be4b-bf66deb6862f tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:36.089775 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-4cdded41-a370-47af-be4b-bf66deb6862f tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: 8c73af69-886c-4f22-a6d3-001f566d3277] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:36.097142 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4cdded41-a370-47af-be4b-bf66deb6862f tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:36.097757 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4cdded41-a370-47af-be4b-bf66deb6862f tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:36.098366 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4cdded41-a370-47af-be4b-bf66deb6862f tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:36.098798 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4cdded41-a370-47af-be4b-bf66deb6862f tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:36.128409 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-4cdded41-a370-47af-be4b-bf66deb6862f tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: 8c73af69-886c-4f22-a6d3-001f566d3277] Going to try to terminate instance {{(pid=117723) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:08:36.224196 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-4cdded41-a370-47af-be4b-bf66deb6862f tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "DELETE /compute/v2.1/servers/8c73af69-886c-4f22-a6d3-001f566d3277" status: 204 len: 0 microversion: 2.1 time: 0.138731 May 26 18:08:36.224891 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 448/925] 10.222.0.69 () {58 vars in 1238 bytes} [Thu May 26 18:08:36 2022] DELETE /compute/v2.1/servers/8c73af69-886c-4f22-a6d3-001f566d3277 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 18:08:36.235654 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-86cca095-cf89-4f50-91a3-45e950bf25f5 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:36.236392 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-86cca095-cf89-4f50-91a3-45e950bf25f5 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: 8c73af69-886c-4f22-a6d3-001f566d3277] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:36.242830 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-86cca095-cf89-4f50-91a3-45e950bf25f5 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:36.243371 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-86cca095-cf89-4f50-91a3-45e950bf25f5 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:36.244406 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-86cca095-cf89-4f50-91a3-45e950bf25f5 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:36.245013 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-86cca095-cf89-4f50-91a3-45e950bf25f5 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:36.650217 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-86cca095-cf89-4f50-91a3-45e950bf25f5 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683ec43ae844757883a7dd5003b53d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a75cf80284f58b9c3bed674677a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:36.660297 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-86cca095-cf89-4f50-91a3-45e950bf25f5 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "GET /compute/v2.1/servers/8c73af69-886c-4f22-a6d3-001f566d3277" status: 200 len: 1576 microversion: 2.1 time: 0.430418 May 26 18:08:36.661201 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 478/926] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:08:36 2022] GET /compute/v2.1/servers/8c73af69-886c-4f22-a6d3-001f566d3277 => generated 1576 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:37.680950 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-ebe19c75-e627-4762-b620-a6e53b531ec2 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:37.681679 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-ebe19c75-e627-4762-b620-a6e53b531ec2 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: 8c73af69-886c-4f22-a6d3-001f566d3277] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:37.692386 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ebe19c75-e627-4762-b620-a6e53b531ec2 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:37.692877 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ebe19c75-e627-4762-b620-a6e53b531ec2 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:37.693697 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ebe19c75-e627-4762-b620-a6e53b531ec2 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:37.694142 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ebe19c75-e627-4762-b620-a6e53b531ec2 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:37.901506 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-ebe19c75-e627-4762-b620-a6e53b531ec2 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683ec43ae844757883a7dd5003b53d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a75cf80284f58b9c3bed674677a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:37.915184 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-ebe19c75-e627-4762-b620-a6e53b531ec2 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "GET /compute/v2.1/servers/8c73af69-886c-4f22-a6d3-001f566d3277" status: 200 len: 1576 microversion: 2.1 time: 0.238389 May 26 18:08:37.925471 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 449/927] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:08:37 2022] GET /compute/v2.1/servers/8c73af69-886c-4f22-a6d3-001f566d3277 => generated 1576 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:08:38.810429 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [req-135a5bd3-bcc6-4e48-b19b-98ff18ea8898 req-77109981-2e09-49e9-a8ee-71d0ecee21fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c73af69-886c-4f22-a6d3-001f566d3277", "name": "network-vif-deleted", "tag": "0be12dc6-5e46-49db-9a74-e8a86e2b117d"}]} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:08:38.833441 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-135a5bd3-bcc6-4e48-b19b-98ff18ea8898 req-77109981-2e09-49e9-a8ee-71d0ecee21fd service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:38.834108 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-135a5bd3-bcc6-4e48-b19b-98ff18ea8898 req-77109981-2e09-49e9-a8ee-71d0ecee21fd service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:38.853748 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.compute.server_external_events [req-135a5bd3-bcc6-4e48-b19b-98ff18ea8898 req-77109981-2e09-49e9-a8ee-71d0ecee21fd service nova] Creating event network-vif-deleted:0be12dc6-5e46-49db-9a74-e8a86e2b117d for instance 8c73af69-886c-4f22-a6d3-001f566d3277 on hv-cinder-83607 May 26 18:08:38.861451 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [req-135a5bd3-bcc6-4e48-b19b-98ff18ea8898 req-77109981-2e09-49e9-a8ee-71d0ecee21fd service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069516 May 26 18:08:38.862075 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 479/928] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:08:38.942095 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-a266f3a4-9be8-467a-93c5-d63a6b64015c tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:38.943581 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-a266f3a4-9be8-467a-93c5-d63a6b64015c tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: 8c73af69-886c-4f22-a6d3-001f566d3277] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:38.959562 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a266f3a4-9be8-467a-93c5-d63a6b64015c tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:38.960480 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a266f3a4-9be8-467a-93c5-d63a6b64015c tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:38.961930 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a266f3a4-9be8-467a-93c5-d63a6b64015c tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:38.962716 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a266f3a4-9be8-467a-93c5-d63a6b64015c tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:39.045527 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-a266f3a4-9be8-467a-93c5-d63a6b64015c tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683ec43ae844757883a7dd5003b53d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a75cf80284f58b9c3bed674677a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:39.056707 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-a266f3a4-9be8-467a-93c5-d63a6b64015c tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "GET /compute/v2.1/servers/8c73af69-886c-4f22-a6d3-001f566d3277" status: 200 len: 1225 microversion: 2.1 time: 0.124915 May 26 18:08:39.057504 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 450/929] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:08:38 2022] GET /compute/v2.1/servers/8c73af69-886c-4f22-a6d3-001f566d3277 => generated 1225 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:40.082828 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-c04d68e1-d554-4601-93a5-ca1964ee9aec tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:40.083870 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-c04d68e1-d554-4601-93a5-ca1964ee9aec tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: 8c73af69-886c-4f22-a6d3-001f566d3277] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:40.094974 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c04d68e1-d554-4601-93a5-ca1964ee9aec tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:40.095812 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c04d68e1-d554-4601-93a5-ca1964ee9aec tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:40.096892 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c04d68e1-d554-4601-93a5-ca1964ee9aec tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:40.097421 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c04d68e1-d554-4601-93a5-ca1964ee9aec tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:40.115963 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.wsgi [None req-c04d68e1-d554-4601-93a5-ca1964ee9aec tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] HTTP exception thrown: Instance 8c73af69-886c-4f22-a6d3-001f566d3277 could not be found. May 26 18:08:40.118146 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-c04d68e1-d554-4601-93a5-ca1964ee9aec tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Request method failure captured: May 26 18:08:40.118146 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: request: GET /compute/v2.1/servers/8c73af69-886c-4f22-a6d3-001f566d3277 HTTP/1.1 May 26 18:08:40.118146 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Accept: application/json May 26 18:08:40.118146 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Accept-Encoding: identity May 26 18:08:40.118146 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Connection: close May 26 18:08:40.118146 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Content-Length: 0 May 26 18:08:40.118146 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Content-Type: application/json May 26 18:08:40.118146 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Host: 10.222.0.69 May 26 18:08:40.118146 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Openstack-System-Scope: None May 26 18:08:40.118146 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: User-Agent: python-urllib3/1.26.9 May 26 18:08:40.118146 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Auth-Token: gAAAAABij8FyoxciT5YEzji_ZgoA_N96i2J26DPiyFqPfiWqDD3oVYI-hpQmOxkOrQGj00Dd5rApgP97YeMjNWN9mXaywxuTdw5gYJgojEwOxn91Op2W8jTPbeqsh5xoGhad_x0WZe9M01ZEPTHfW6fv_3JVyS0vC-dZ7CmZlsZI-bUtzFR1CvM May 26 18:08:40.118146 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Domain-Id: None May 26 18:08:40.118146 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Domain-Name: None May 26 18:08:40.118146 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Identity-Status: Confirmed May 26 18:08:40.118146 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Is-Admin-Project: True May 26 18:08:40.118146 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Domain-Id: default May 26 18:08:40.118146 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Domain-Name: Default May 26 18:08:40.118146 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Id: ba5a75cf80284f58b9c3bed674677a39 May 26 18:08:40.118146 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Name: tempest-TestVolumeBootPattern-613694807 May 26 18:08:40.118146 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Role: member,reader May 26 18:08:40.118146 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Roles: member,reader May 26 18:08:40.120061 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ba5a75cf80284f58b9c3bed674677a39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ba5a75cf80284f58b9c3bed674677a39"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ba5a75cf80284f58b9c3bed674677a39"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ba5a75cf80284f58b9c3bed674677a39"}]}] May 26 18:08:40.120061 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant: tempest-TestVolumeBootPattern-613694807 May 26 18:08:40.120061 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant-Id: ba5a75cf80284f58b9c3bed674677a39 May 26 18:08:40.120061 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant-Name: tempest-TestVolumeBootPattern-613694807 May 26 18:08:40.120061 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User: tempest-TestVolumeBootPattern-613694807-project May 26 18:08:40.120061 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Domain-Id: default May 26 18:08:40.120061 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Domain-Name: Default May 26 18:08:40.120061 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Id: 9683ec43ae844757883a7dd5003b53d9 May 26 18:08:40.120061 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Name: tempest-TestVolumeBootPattern-613694807-project May 26 18:08:40.120061 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: method: > May 26 18:08:40.120061 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: exception: Instance 8c73af69-886c-4f22-a6d3-001f566d3277 could not be found. May 26 18:08:40.120061 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: action_args: {'id': '8c73af69-886c-4f22-a6d3-001f566d3277'} May 26 18:08:40.121081 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:08:40.121081 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:40.121081 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:08:40.121081 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:08:40.121081 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:08:40.121081 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:08:40.121081 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:08:40.121081 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:08:40.121081 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:08:40.121081 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:08:40.121081 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c73af69-886c-4f22-a6d3-001f566d3277 could not be found. May 26 18:08:40.121081 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:08:40.121081 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:40.121081 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:08:40.121081 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:40.121081 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:08:40.121081 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:08:40.121081 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:08:40.121081 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:08:40.121081 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:08:40.122582 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:08:40.122582 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:08:40.122582 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:08:40.122582 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:08:40.122582 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:08:40.122582 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:08:40.122582 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:08:40.122582 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c73af69-886c-4f22-a6d3-001f566d3277 could not be found. May 26 18:08:40.122582 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:08:40.122582 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:40.122582 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:08:40.122582 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:40.122582 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:08:40.122582 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:08:40.122582 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:08:40.122582 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:08:40.122582 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c73af69-886c-4f22-a6d3-001f566d3277 could not be found. May 26 18:08:40.122582 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:08:40.123933 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-c04d68e1-d554-4601-93a5-ca1964ee9aec tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Returning 404 to user: Instance 8c73af69-886c-4f22-a6d3-001f566d3277 could not be found. {{(pid=117722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:08:40.123933 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-c04d68e1-d554-4601-93a5-ca1964ee9aec tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "GET /compute/v2.1/servers/8c73af69-886c-4f22-a6d3-001f566d3277" status: 404 len: 111 microversion: 2.1 time: 0.044128 May 26 18:08:40.123933 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 480/930] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:08:40 2022] GET /compute/v2.1/servers/8c73af69-886c-4f22-a6d3-001f566d3277 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:08:40.272950 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-b40d776c-2fc7-4410-8640-0f7a26d1d7c8 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-568740929", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-388820237", "security_groups": [{"name": "tempest-secgroup-smoke-714810901"}], "block_device_mapping_v2": [{"uuid": "4d0880ce-2ee1-4d76-944b-b39532fe306e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7d5a4e77-6968-4ef2-a95a-0d27f89b0d76"}]}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:08:40.412398 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.network.neutron [None req-b40d776c-2fc7-4410-8640-0f7a26d1d7c8 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] validate_networks() for [('7d5a4e77-6968-4ef2-a95a-0d27f89b0d76', None, None, None, None, None)] {{(pid=117723) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:08:40.843044 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-b40d776c-2fc7-4410-8640-0f7a26d1d7c8 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Flavor limits 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:08:40.846105 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-b40d776c-2fc7-4410-8640-0f7a26d1d7c8 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Image limits 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:08:40.847976 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-b40d776c-2fc7-4410-8640-0f7a26d1d7c8 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Flavor pref 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:08:40.848805 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-b40d776c-2fc7-4410-8640-0f7a26d1d7c8 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Image pref 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:08:40.849797 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-b40d776c-2fc7-4410-8640-0f7a26d1d7c8 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:08:40.868303 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b40d776c-2fc7-4410-8640-0f7a26d1d7c8 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:40.869042 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b40d776c-2fc7-4410-8640-0f7a26d1d7c8 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:40.870386 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b40d776c-2fc7-4410-8640-0f7a26d1d7c8 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:40.871121 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b40d776c-2fc7-4410-8640-0f7a26d1d7c8 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:40.905624 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-b40d776c-2fc7-4410-8640-0f7a26d1d7c8 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Getting quotas for project ba5a75cf80284f58b9c3bed674677a39. Resources: {'instances', 'ram', 'cores'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:08:40.910482 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-b40d776c-2fc7-4410-8640-0f7a26d1d7c8 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Getting quotas for user 9683ec43ae844757883a7dd5003b53d9 and project ba5a75cf80284f58b9c3bed674677a39. Resources: {'instances', 'ram', 'cores'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:08:40.987933 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-b40d776c-2fc7-4410-8640-0f7a26d1d7c8 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Going to run 1 instances... {{(pid=117723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:08:40.988922 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-b40d776c-2fc7-4410-8640-0f7a26d1d7c8 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: e8ab62c1-6839-4a58-9dd4-848eed83661c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4d0880ce-2ee1-4d76-944b-b39532fe306e',volume_size=None,volume_type=None)] {{(pid=117723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:08:41.154911 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-b40d776c-2fc7-4410-8640-0f7a26d1d7c8 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.886413 May 26 18:08:41.155776 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 451/931] 10.222.0.69 () {60 vars in 1146 bytes} [Thu May 26 18:08:40 2022] POST /compute/v2.1/servers => generated 405 bytes in 888 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 18:08:41.167547 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-db0d86ae-e2d3-4055-8450-42ab3e4bbb88 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:41.168362 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-db0d86ae-e2d3-4055-8450-42ab3e4bbb88 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: e8ab62c1-6839-4a58-9dd4-848eed83661c] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:41.239241 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-db0d86ae-e2d3-4055-8450-42ab3e4bbb88 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683ec43ae844757883a7dd5003b53d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a75cf80284f58b9c3bed674677a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:41.246978 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-db0d86ae-e2d3-4055-8450-42ab3e4bbb88 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "GET /compute/v2.1/servers/e8ab62c1-6839-4a58-9dd4-848eed83661c" status: 200 len: 1093 microversion: 2.1 time: 0.084318 May 26 18:08:41.248059 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 481/932] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:08:41 2022] GET /compute/v2.1/servers/e8ab62c1-6839-4a58-9dd4-848eed83661c => generated 1093 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:08:41.767070 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-9168fc71-8f22-470d-bd45-0281f1b27a06 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:41.767871 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-9168fc71-8f22-470d-bd45-0281f1b27a06 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 99ba7c81-2ccc-489b-b4d7-166ea0d3772f] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:41.774347 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9168fc71-8f22-470d-bd45-0281f1b27a06 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:41.774799 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9168fc71-8f22-470d-bd45-0281f1b27a06 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:41.775587 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9168fc71-8f22-470d-bd45-0281f1b27a06 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:41.776044 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9168fc71-8f22-470d-bd45-0281f1b27a06 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:41.878944 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.objects.instance [None req-9168fc71-8f22-470d-bd45-0281f1b27a06 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lazy-loading 'services' on Instance uuid 99ba7c81-2ccc-489b-b4d7-166ea0d3772f {{(pid=117723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:08:41.968872 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-9168fc71-8f22-470d-bd45-0281f1b27a06 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "DELETE /compute/v2.1/servers/99ba7c81-2ccc-489b-b4d7-166ea0d3772f/os-volume_attachments/b67e62a7-281b-40c1-909e-5f0dee3688f6" status: 202 len: 0 microversion: 2.1 time: 0.206352 May 26 18:08:41.969489 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 452/933] 10.222.0.69 () {58 vars in 1415 bytes} [Thu May 26 18:08:41 2022] DELETE /compute/v2.1/servers/99ba7c81-2ccc-489b-b4d7-166ea0d3772f/os-volume_attachments/b67e62a7-281b-40c1-909e-5f0dee3688f6 => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:08:41.978481 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-28a1d4a3-c7cd-4219-86b7-0a45d0e3b8e5 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:41.979500 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-28a1d4a3-c7cd-4219-86b7-0a45d0e3b8e5 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 99ba7c81-2ccc-489b-b4d7-166ea0d3772f] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:41.987903 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-28a1d4a3-c7cd-4219-86b7-0a45d0e3b8e5 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:41.988399 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-28a1d4a3-c7cd-4219-86b7-0a45d0e3b8e5 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:41.989244 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-28a1d4a3-c7cd-4219-86b7-0a45d0e3b8e5 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:41.989654 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-28a1d4a3-c7cd-4219-86b7-0a45d0e3b8e5 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:42.022464 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-28a1d4a3-c7cd-4219-86b7-0a45d0e3b8e5 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/99ba7c81-2ccc-489b-b4d7-166ea0d3772f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048011 May 26 18:08:42.022960 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 482/934] 10.222.0.69 () {58 vars in 1301 bytes} [Thu May 26 18:08:41 2022] GET /compute/v2.1/servers/99ba7c81-2ccc-489b-b4d7-166ea0d3772f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:08:42.265951 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-e13f91e0-c454-45f3-8f3c-f9d2f52f4703 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:42.267119 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-e13f91e0-c454-45f3-8f3c-f9d2f52f4703 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: e8ab62c1-6839-4a58-9dd4-848eed83661c] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:42.276736 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e13f91e0-c454-45f3-8f3c-f9d2f52f4703 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:42.277142 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e13f91e0-c454-45f3-8f3c-f9d2f52f4703 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:42.278162 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e13f91e0-c454-45f3-8f3c-f9d2f52f4703 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:42.278908 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e13f91e0-c454-45f3-8f3c-f9d2f52f4703 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:42.359973 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-e13f91e0-c454-45f3-8f3c-f9d2f52f4703 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683ec43ae844757883a7dd5003b53d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a75cf80284f58b9c3bed674677a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:42.368125 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-e13f91e0-c454-45f3-8f3c-f9d2f52f4703 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "GET /compute/v2.1/servers/e8ab62c1-6839-4a58-9dd4-848eed83661c" status: 200 len: 1209 microversion: 2.1 time: 0.106664 May 26 18:08:42.368881 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 453/935] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:08:42 2022] GET /compute/v2.1/servers/e8ab62c1-6839-4a58-9dd4-848eed83661c => generated 1209 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:43.037252 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-aca5f5fa-214c-4ab9-ad54-40fb23e522b9 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:43.038511 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-aca5f5fa-214c-4ab9-ad54-40fb23e522b9 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 99ba7c81-2ccc-489b-b4d7-166ea0d3772f] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:43.047700 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-aca5f5fa-214c-4ab9-ad54-40fb23e522b9 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:43.048268 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-aca5f5fa-214c-4ab9-ad54-40fb23e522b9 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:43.049137 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-aca5f5fa-214c-4ab9-ad54-40fb23e522b9 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:43.049615 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-aca5f5fa-214c-4ab9-ad54-40fb23e522b9 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:43.091450 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-aca5f5fa-214c-4ab9-ad54-40fb23e522b9 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/99ba7c81-2ccc-489b-b4d7-166ea0d3772f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060638 May 26 18:08:43.092149 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 483/936] 10.222.0.69 () {58 vars in 1301 bytes} [Thu May 26 18:08:43 2022] GET /compute/v2.1/servers/99ba7c81-2ccc-489b-b4d7-166ea0d3772f/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 26 18:08:43.186669 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-f72acfe6-985b-4662-a475-8dcc4d6e51d3 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:43.188205 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-f72acfe6-985b-4662-a475-8dcc4d6e51d3 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 99ba7c81-2ccc-489b-b4d7-166ea0d3772f] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:43.199160 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f72acfe6-985b-4662-a475-8dcc4d6e51d3 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:43.200136 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f72acfe6-985b-4662-a475-8dcc4d6e51d3 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:43.200940 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f72acfe6-985b-4662-a475-8dcc4d6e51d3 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:43.202217 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f72acfe6-985b-4662-a475-8dcc4d6e51d3 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:43.241961 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-f72acfe6-985b-4662-a475-8dcc4d6e51d3 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 99ba7c81-2ccc-489b-b4d7-166ea0d3772f] Going to try to terminate instance {{(pid=117723) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:08:43.397714 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-b4b614a1-44c5-4526-b8bc-d5deb183f7e6 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:43.399250 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-b4b614a1-44c5-4526-b8bc-d5deb183f7e6 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: e8ab62c1-6839-4a58-9dd4-848eed83661c] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:43.408832 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-f72acfe6-985b-4662-a475-8dcc4d6e51d3 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "DELETE /compute/v2.1/servers/99ba7c81-2ccc-489b-b4d7-166ea0d3772f" status: 204 len: 0 microversion: 2.1 time: 0.226488 May 26 18:08:43.414382 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 454/937] 10.222.0.69 () {58 vars in 1238 bytes} [Thu May 26 18:08:43 2022] DELETE /compute/v2.1/servers/99ba7c81-2ccc-489b-b4d7-166ea0d3772f => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 18:08:43.414727 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b4b614a1-44c5-4526-b8bc-d5deb183f7e6 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:43.415418 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b4b614a1-44c5-4526-b8bc-d5deb183f7e6 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:43.416588 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b4b614a1-44c5-4526-b8bc-d5deb183f7e6 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:43.417649 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b4b614a1-44c5-4526-b8bc-d5deb183f7e6 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:43.428391 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-8698c92a-f421-41ff-b9c7-47ec88bc1386 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:43.430399 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-8698c92a-f421-41ff-b9c7-47ec88bc1386 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 99ba7c81-2ccc-489b-b4d7-166ea0d3772f] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:43.441546 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8698c92a-f421-41ff-b9c7-47ec88bc1386 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:43.442228 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8698c92a-f421-41ff-b9c7-47ec88bc1386 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:43.443469 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8698c92a-f421-41ff-b9c7-47ec88bc1386 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:43.444325 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8698c92a-f421-41ff-b9c7-47ec88bc1386 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:43.582212 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-b4b614a1-44c5-4526-b8bc-d5deb183f7e6 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683ec43ae844757883a7dd5003b53d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a75cf80284f58b9c3bed674677a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:43.591369 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-b4b614a1-44c5-4526-b8bc-d5deb183f7e6 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "GET /compute/v2.1/servers/e8ab62c1-6839-4a58-9dd4-848eed83661c" status: 200 len: 1276 microversion: 2.1 time: 0.201393 May 26 18:08:43.592008 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 484/938] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:08:43 2022] GET /compute/v2.1/servers/e8ab62c1-6839-4a58-9dd4-848eed83661c => generated 1276 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:43.680256 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-8698c92a-f421-41ff-b9c7-47ec88bc1386 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:43.692471 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-8698c92a-f421-41ff-b9c7-47ec88bc1386 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/99ba7c81-2ccc-489b-b4d7-166ea0d3772f" status: 200 len: 1681 microversion: 2.1 time: 0.276485 May 26 18:08:43.693374 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 455/939] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:08:43 2022] GET /compute/v2.1/servers/99ba7c81-2ccc-489b-b4d7-166ea0d3772f => generated 1681 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:44.610405 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-762e93f9-16bc-4b21-9b70-5bc31d51ef18 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:44.611765 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-762e93f9-16bc-4b21-9b70-5bc31d51ef18 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: e8ab62c1-6839-4a58-9dd4-848eed83661c] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:44.618107 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-762e93f9-16bc-4b21-9b70-5bc31d51ef18 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:44.621500 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-762e93f9-16bc-4b21-9b70-5bc31d51ef18 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:44.622363 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-762e93f9-16bc-4b21-9b70-5bc31d51ef18 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:44.622817 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-762e93f9-16bc-4b21-9b70-5bc31d51ef18 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:44.710874 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-600b4874-5d5d-443f-8dff-fb3a2fd13c58 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:44.711738 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-600b4874-5d5d-443f-8dff-fb3a2fd13c58 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 99ba7c81-2ccc-489b-b4d7-166ea0d3772f] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:44.720281 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-600b4874-5d5d-443f-8dff-fb3a2fd13c58 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:44.721141 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-600b4874-5d5d-443f-8dff-fb3a2fd13c58 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:44.722528 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-600b4874-5d5d-443f-8dff-fb3a2fd13c58 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:44.723158 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-600b4874-5d5d-443f-8dff-fb3a2fd13c58 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:44.888611 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-600b4874-5d5d-443f-8dff-fb3a2fd13c58 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:44.897502 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-600b4874-5d5d-443f-8dff-fb3a2fd13c58 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/99ba7c81-2ccc-489b-b4d7-166ea0d3772f" status: 200 len: 1681 microversion: 2.1 time: 0.190444 May 26 18:08:44.898097 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 456/940] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:08:44 2022] GET /compute/v2.1/servers/99ba7c81-2ccc-489b-b4d7-166ea0d3772f => generated 1681 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:08:44.918105 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-762e93f9-16bc-4b21-9b70-5bc31d51ef18 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683ec43ae844757883a7dd5003b53d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a75cf80284f58b9c3bed674677a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:44.928898 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-762e93f9-16bc-4b21-9b70-5bc31d51ef18 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "GET /compute/v2.1/servers/e8ab62c1-6839-4a58-9dd4-848eed83661c" status: 200 len: 1276 microversion: 2.1 time: 0.321976 May 26 18:08:44.929507 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 485/941] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:08:44 2022] GET /compute/v2.1/servers/e8ab62c1-6839-4a58-9dd4-848eed83661c => generated 1276 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:45.915577 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-f69fd614-acef-4d48-933c-fd541d39dcab tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:45.916229 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-f69fd614-acef-4d48-933c-fd541d39dcab tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 99ba7c81-2ccc-489b-b4d7-166ea0d3772f] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:45.928117 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f69fd614-acef-4d48-933c-fd541d39dcab tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:45.929021 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f69fd614-acef-4d48-933c-fd541d39dcab tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:45.929817 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f69fd614-acef-4d48-933c-fd541d39dcab tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:45.930449 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f69fd614-acef-4d48-933c-fd541d39dcab tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:45.948058 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-0a5a06b8-d370-44ac-a2c0-2496a3e48c37 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:45.948666 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-0a5a06b8-d370-44ac-a2c0-2496a3e48c37 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: e8ab62c1-6839-4a58-9dd4-848eed83661c] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:45.965521 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0a5a06b8-d370-44ac-a2c0-2496a3e48c37 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:45.965889 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0a5a06b8-d370-44ac-a2c0-2496a3e48c37 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:45.966681 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0a5a06b8-d370-44ac-a2c0-2496a3e48c37 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:45.967116 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0a5a06b8-d370-44ac-a2c0-2496a3e48c37 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:46.041479 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-f69fd614-acef-4d48-933c-fd541d39dcab tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:46.050405 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-f69fd614-acef-4d48-933c-fd541d39dcab tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/99ba7c81-2ccc-489b-b4d7-166ea0d3772f" status: 200 len: 1613 microversion: 2.1 time: 0.139084 May 26 18:08:46.050999 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 457/942] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:08:45 2022] GET /compute/v2.1/servers/99ba7c81-2ccc-489b-b4d7-166ea0d3772f => generated 1613 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:46.069325 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-40ab96c7-5357-4b2d-82a5-8641cad97abb req-50edb591-cba6-46d8-a9ce-359167576a95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8ab62c1-6839-4a58-9dd4-848eed83661c", "tag": "c33d9d21-0d51-4503-906b-480b6fb62472"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:08:46.086128 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-40ab96c7-5357-4b2d-82a5-8641cad97abb req-50edb591-cba6-46d8-a9ce-359167576a95 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:46.086500 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-40ab96c7-5357-4b2d-82a5-8641cad97abb req-50edb591-cba6-46d8-a9ce-359167576a95 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:46.101894 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-40ab96c7-5357-4b2d-82a5-8641cad97abb req-50edb591-cba6-46d8-a9ce-359167576a95 service nova] Creating event network-changed:c33d9d21-0d51-4503-906b-480b6fb62472 for instance e8ab62c1-6839-4a58-9dd4-848eed83661c on hv-cinder-83607 May 26 18:08:46.111843 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-40ab96c7-5357-4b2d-82a5-8641cad97abb req-50edb591-cba6-46d8-a9ce-359167576a95 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045982 May 26 18:08:46.112573 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 458/943] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:08:46.427672 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-0a5a06b8-d370-44ac-a2c0-2496a3e48c37 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683ec43ae844757883a7dd5003b53d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a75cf80284f58b9c3bed674677a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:46.436563 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-0a5a06b8-d370-44ac-a2c0-2496a3e48c37 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "GET /compute/v2.1/servers/e8ab62c1-6839-4a58-9dd4-848eed83661c" status: 200 len: 1264 microversion: 2.1 time: 0.493173 May 26 18:08:46.437153 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 486/944] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:08:45 2022] GET /compute/v2.1/servers/e8ab62c1-6839-4a58-9dd4-848eed83661c => generated 1264 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:08:47.070903 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-385384f1-f54b-4bec-a0e3-8d0f2fc4a794 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:47.071825 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-385384f1-f54b-4bec-a0e3-8d0f2fc4a794 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 99ba7c81-2ccc-489b-b4d7-166ea0d3772f] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:47.082576 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-385384f1-f54b-4bec-a0e3-8d0f2fc4a794 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:47.083045 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-385384f1-f54b-4bec-a0e3-8d0f2fc4a794 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:47.084190 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-385384f1-f54b-4bec-a0e3-8d0f2fc4a794 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:47.084995 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-385384f1-f54b-4bec-a0e3-8d0f2fc4a794 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:47.166278 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-385384f1-f54b-4bec-a0e3-8d0f2fc4a794 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2691e1dc96e942b5ba4c726b72a835e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8920d2de9dc34386bb0e770f5b51b702', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:47.176710 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-385384f1-f54b-4bec-a0e3-8d0f2fc4a794 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/99ba7c81-2ccc-489b-b4d7-166ea0d3772f" status: 200 len: 1613 microversion: 2.1 time: 0.112356 May 26 18:08:47.177300 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 459/945] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:08:47 2022] GET /compute/v2.1/servers/99ba7c81-2ccc-489b-b4d7-166ea0d3772f => generated 1613 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:47.455226 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-b011e52c-702d-48e8-a1d6-f5e131aa46a8 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:47.456002 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-b011e52c-702d-48e8-a1d6-f5e131aa46a8 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: e8ab62c1-6839-4a58-9dd4-848eed83661c] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:47.464580 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b011e52c-702d-48e8-a1d6-f5e131aa46a8 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:47.465605 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b011e52c-702d-48e8-a1d6-f5e131aa46a8 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:47.466708 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b011e52c-702d-48e8-a1d6-f5e131aa46a8 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:47.467537 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b011e52c-702d-48e8-a1d6-f5e131aa46a8 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:47.631083 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-b011e52c-702d-48e8-a1d6-f5e131aa46a8 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683ec43ae844757883a7dd5003b53d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a75cf80284f58b9c3bed674677a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:47.644324 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-b011e52c-702d-48e8-a1d6-f5e131aa46a8 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "GET /compute/v2.1/servers/e8ab62c1-6839-4a58-9dd4-848eed83661c" status: 200 len: 1264 microversion: 2.1 time: 0.193334 May 26 18:08:47.645382 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 487/946] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:08:47 2022] GET /compute/v2.1/servers/e8ab62c1-6839-4a58-9dd4-848eed83661c => generated 1264 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:48.189422 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-8ae5706a-a426-4b74-9334-6da3fe611219 req-405594b9-2654-42c8-a47c-ae8ccf59e336 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99ba7c81-2ccc-489b-b4d7-166ea0d3772f", "name": "network-vif-deleted", "tag": "fdeaf409-3755-40ac-949e-78986d168e71"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:08:48.196717 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-d50d5bf9-ee8f-41db-bdd7-d71906734a14 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:48.197758 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-d50d5bf9-ee8f-41db-bdd7-d71906734a14 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 99ba7c81-2ccc-489b-b4d7-166ea0d3772f] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:48.208467 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-8ae5706a-a426-4b74-9334-6da3fe611219 req-405594b9-2654-42c8-a47c-ae8ccf59e336 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:48.209315 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-8ae5706a-a426-4b74-9334-6da3fe611219 req-405594b9-2654-42c8-a47c-ae8ccf59e336 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:48.217981 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d50d5bf9-ee8f-41db-bdd7-d71906734a14 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:48.218445 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d50d5bf9-ee8f-41db-bdd7-d71906734a14 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:48.219742 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d50d5bf9-ee8f-41db-bdd7-d71906734a14 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:48.220248 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d50d5bf9-ee8f-41db-bdd7-d71906734a14 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:48.233734 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-8ae5706a-a426-4b74-9334-6da3fe611219 req-405594b9-2654-42c8-a47c-ae8ccf59e336 service nova] Creating event network-vif-deleted:fdeaf409-3755-40ac-949e-78986d168e71 for instance 99ba7c81-2ccc-489b-b4d7-166ea0d3772f on hv-cinder-83607 May 26 18:08:48.243172 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.wsgi [None req-d50d5bf9-ee8f-41db-bdd7-d71906734a14 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] HTTP exception thrown: Instance 99ba7c81-2ccc-489b-b4d7-166ea0d3772f could not be found. May 26 18:08:48.245872 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-d50d5bf9-ee8f-41db-bdd7-d71906734a14 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Request method failure captured: May 26 18:08:48.245872 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: request: GET /compute/v2.1/servers/99ba7c81-2ccc-489b-b4d7-166ea0d3772f HTTP/1.1 May 26 18:08:48.245872 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Accept: application/json May 26 18:08:48.245872 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Accept-Encoding: identity May 26 18:08:48.245872 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Connection: close May 26 18:08:48.245872 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Content-Length: 0 May 26 18:08:48.245872 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Content-Type: application/json May 26 18:08:48.245872 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Host: 10.222.0.69 May 26 18:08:48.245872 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Openstack-System-Scope: None May 26 18:08:48.245872 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: User-Agent: python-urllib3/1.26.9 May 26 18:08:48.245872 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Auth-Token: gAAAAABij8DD0GGF2lSLDsyvjDvkvKuYTmd8MhBJFcuAgLQjYIxaUzVYvy2y78Ufugs1Oc4LrOO28-M4MWgXvAjDAFM656TsVGzxmhayY-bOw7ExJ5yRcG231tnUdWRr6zrbitvFAB7wzSB1IdWp2Auh8VsxEfhGR0YnizUXC6yVsCWiAksLALA May 26 18:08:48.245872 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Domain-Id: None May 26 18:08:48.245872 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Domain-Name: None May 26 18:08:48.245872 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Identity-Status: Confirmed May 26 18:08:48.245872 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Is-Admin-Project: True May 26 18:08:48.245872 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Domain-Id: default May 26 18:08:48.245872 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Domain-Name: Default May 26 18:08:48.245872 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Id: 8920d2de9dc34386bb0e770f5b51b702 May 26 18:08:48.245872 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Name: tempest-AttachVolumeNegativeTest-2031663802 May 26 18:08:48.245872 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Role: member,reader May 26 18:08:48.245872 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Roles: member,reader May 26 18:08:48.247585 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8920d2de9dc34386bb0e770f5b51b702"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8920d2de9dc34386bb0e770f5b51b702"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8920d2de9dc34386bb0e770f5b51b702"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8920d2de9dc34386bb0e770f5b51b702"}]}] May 26 18:08:48.247585 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant: tempest-AttachVolumeNegativeTest-2031663802 May 26 18:08:48.247585 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant-Id: 8920d2de9dc34386bb0e770f5b51b702 May 26 18:08:48.247585 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2031663802 May 26 18:08:48.247585 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User: tempest-AttachVolumeNegativeTest-2031663802-project May 26 18:08:48.247585 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Domain-Id: default May 26 18:08:48.247585 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Domain-Name: Default May 26 18:08:48.247585 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Id: 2691e1dc96e942b5ba4c726b72a835e9 May 26 18:08:48.247585 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Name: tempest-AttachVolumeNegativeTest-2031663802-project May 26 18:08:48.247585 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: method: > May 26 18:08:48.247585 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: exception: Instance 99ba7c81-2ccc-489b-b4d7-166ea0d3772f could not be found. May 26 18:08:48.247585 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: action_args: {'id': '99ba7c81-2ccc-489b-b4d7-166ea0d3772f'} May 26 18:08:48.248568 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:08:48.248568 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:48.248568 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:08:48.248568 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:08:48.248568 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:08:48.248568 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:08:48.248568 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:08:48.248568 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:08:48.248568 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:08:48.248568 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:08:48.248568 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99ba7c81-2ccc-489b-b4d7-166ea0d3772f could not be found. May 26 18:08:48.248568 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:08:48.248568 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:48.248568 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:08:48.248568 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:48.248568 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:08:48.248568 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:08:48.248568 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:08:48.248568 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:08:48.248568 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:08:48.250078 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:08:48.250078 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:08:48.250078 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:08:48.250078 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:08:48.250078 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:08:48.250078 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:08:48.250078 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:08:48.250078 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99ba7c81-2ccc-489b-b4d7-166ea0d3772f could not be found. May 26 18:08:48.250078 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:08:48.250078 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:48.250078 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:08:48.250078 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:48.250078 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:08:48.250078 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:08:48.250078 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:08:48.250078 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:08:48.250078 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99ba7c81-2ccc-489b-b4d7-166ea0d3772f could not be found. May 26 18:08:48.250078 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:08:48.252903 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-8ae5706a-a426-4b74-9334-6da3fe611219 req-405594b9-2654-42c8-a47c-ae8ccf59e336 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066765 May 26 18:08:48.252903 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 460/947] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:08:48.254599 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-d50d5bf9-ee8f-41db-bdd7-d71906734a14 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Returning 404 to user: Instance 99ba7c81-2ccc-489b-b4d7-166ea0d3772f could not be found. {{(pid=117722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:08:48.255529 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-d50d5bf9-ee8f-41db-bdd7-d71906734a14 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/99ba7c81-2ccc-489b-b4d7-166ea0d3772f" status: 404 len: 111 microversion: 2.1 time: 0.064504 May 26 18:08:48.256459 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 488/948] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:08:48 2022] GET /compute/v2.1/servers/99ba7c81-2ccc-489b-b4d7-166ea0d3772f => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:08:48.271676 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-762c94cb-306e-4b95-ae34-d7737038ea23 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '.version_select at 0x7f3ab8b5daf0>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:48.300453 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-762c94cb-306e-4b95-ae34-d7737038ea23 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-538880582" status: 202 len: 0 microversion: 2.1 time: 0.038395 May 26 18:08:48.301516 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 461/949] 10.222.0.69 () {58 vars in 1217 bytes} [Thu May 26 18:08:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-538880582 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:08:48.663344 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-69817342-4bf4-4c0b-9408-a1a0cf8f65bd tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:48.663973 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-69817342-4bf4-4c0b-9408-a1a0cf8f65bd tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: e8ab62c1-6839-4a58-9dd4-848eed83661c] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:48.670897 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-69817342-4bf4-4c0b-9408-a1a0cf8f65bd tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:48.671343 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-69817342-4bf4-4c0b-9408-a1a0cf8f65bd tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:48.672362 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-69817342-4bf4-4c0b-9408-a1a0cf8f65bd tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:48.673016 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-69817342-4bf4-4c0b-9408-a1a0cf8f65bd tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:48.824642 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-69817342-4bf4-4c0b-9408-a1a0cf8f65bd tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683ec43ae844757883a7dd5003b53d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a75cf80284f58b9c3bed674677a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:48.833115 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-69817342-4bf4-4c0b-9408-a1a0cf8f65bd tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "GET /compute/v2.1/servers/e8ab62c1-6839-4a58-9dd4-848eed83661c" status: 200 len: 1264 microversion: 2.1 time: 0.173959 May 26 18:08:48.833809 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 489/950] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:08:48 2022] GET /compute/v2.1/servers/e8ab62c1-6839-4a58-9dd4-848eed83661c => generated 1264 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:49.757830 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-3f9e3f34-be91-4a07-8344-52631783c9a2 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-276684473", "imageRef": "16351c96-cb02-4711-99d5-fd4d80e8a846", "flavorRef": "452", "networks": [{"uuid": "69c7e340-930b-4e5f-9643-c62f279653d3"}]}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:08:49.811895 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.network.neutron [None req-3f9e3f34-be91-4a07-8344-52631783c9a2 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] validate_networks() for [('69c7e340-930b-4e5f-9643-c62f279653d3', None, None, None, None, None)] {{(pid=117723) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:08:49.850974 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-9d33b5dc-4ea8-46d3-b865-8d6f4e38f523 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:49.851582 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-9d33b5dc-4ea8-46d3-b865-8d6f4e38f523 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: e8ab62c1-6839-4a58-9dd4-848eed83661c] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:49.858289 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-9d33b5dc-4ea8-46d3-b865-8d6f4e38f523 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:49.858740 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-9d33b5dc-4ea8-46d3-b865-8d6f4e38f523 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:49.859527 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-9d33b5dc-4ea8-46d3-b865-8d6f4e38f523 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:49.859965 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-9d33b5dc-4ea8-46d3-b865-8d6f4e38f523 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:50.000105 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-9d33b5dc-4ea8-46d3-b865-8d6f4e38f523 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683ec43ae844757883a7dd5003b53d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a75cf80284f58b9c3bed674677a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:50.009006 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-9d33b5dc-4ea8-46d3-b865-8d6f4e38f523 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "GET /compute/v2.1/servers/e8ab62c1-6839-4a58-9dd4-848eed83661c" status: 200 len: 1264 microversion: 2.1 time: 0.162060 May 26 18:08:50.009791 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 490/951] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:08:49 2022] GET /compute/v2.1/servers/e8ab62c1-6839-4a58-9dd4-848eed83661c => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:50.169882 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-84a83bd6-bb2c-4742-ae2f-c6db2511d88f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:50.170468 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-84a83bd6-bb2c-4742-ae2f-c6db2511d88f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 99ba7c81-2ccc-489b-b4d7-166ea0d3772f] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:50.177333 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-84a83bd6-bb2c-4742-ae2f-c6db2511d88f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:50.177791 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-84a83bd6-bb2c-4742-ae2f-c6db2511d88f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:50.178594 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-84a83bd6-bb2c-4742-ae2f-c6db2511d88f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:50.179086 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-84a83bd6-bb2c-4742-ae2f-c6db2511d88f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:50.196449 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.wsgi [None req-84a83bd6-bb2c-4742-ae2f-c6db2511d88f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] HTTP exception thrown: Instance 99ba7c81-2ccc-489b-b4d7-166ea0d3772f could not be found. May 26 18:08:50.201938 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-84a83bd6-bb2c-4742-ae2f-c6db2511d88f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Request method failure captured: May 26 18:08:50.201938 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: request: DELETE /compute/v2.1/servers/99ba7c81-2ccc-489b-b4d7-166ea0d3772f HTTP/1.1 May 26 18:08:50.201938 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Accept: application/json May 26 18:08:50.201938 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Accept-Encoding: identity May 26 18:08:50.201938 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Connection: close May 26 18:08:50.201938 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Content-Length: 0 May 26 18:08:50.201938 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Content-Type: application/json May 26 18:08:50.201938 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Host: 10.222.0.69 May 26 18:08:50.201938 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Openstack-System-Scope: None May 26 18:08:50.201938 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: User-Agent: python-urllib3/1.26.9 May 26 18:08:50.201938 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Auth-Token: gAAAAABij8DD0GGF2lSLDsyvjDvkvKuYTmd8MhBJFcuAgLQjYIxaUzVYvy2y78Ufugs1Oc4LrOO28-M4MWgXvAjDAFM656TsVGzxmhayY-bOw7ExJ5yRcG231tnUdWRr6zrbitvFAB7wzSB1IdWp2Auh8VsxEfhGR0YnizUXC6yVsCWiAksLALA May 26 18:08:50.201938 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Domain-Id: None May 26 18:08:50.201938 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Domain-Name: None May 26 18:08:50.201938 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Identity-Status: Confirmed May 26 18:08:50.201938 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Is-Admin-Project: True May 26 18:08:50.201938 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Domain-Id: default May 26 18:08:50.201938 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Domain-Name: Default May 26 18:08:50.201938 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Id: 8920d2de9dc34386bb0e770f5b51b702 May 26 18:08:50.201938 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Name: tempest-AttachVolumeNegativeTest-2031663802 May 26 18:08:50.201938 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Role: member,reader May 26 18:08:50.201938 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Roles: member,reader May 26 18:08:50.203663 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8920d2de9dc34386bb0e770f5b51b702"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8920d2de9dc34386bb0e770f5b51b702"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8920d2de9dc34386bb0e770f5b51b702"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8920d2de9dc34386bb0e770f5b51b702"}]}] May 26 18:08:50.203663 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant: tempest-AttachVolumeNegativeTest-2031663802 May 26 18:08:50.203663 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant-Id: 8920d2de9dc34386bb0e770f5b51b702 May 26 18:08:50.203663 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2031663802 May 26 18:08:50.203663 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User: tempest-AttachVolumeNegativeTest-2031663802-project May 26 18:08:50.203663 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Domain-Id: default May 26 18:08:50.203663 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Domain-Name: Default May 26 18:08:50.203663 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Id: 2691e1dc96e942b5ba4c726b72a835e9 May 26 18:08:50.203663 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Name: tempest-AttachVolumeNegativeTest-2031663802-project May 26 18:08:50.203663 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: method: > May 26 18:08:50.203663 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: exception: Instance 99ba7c81-2ccc-489b-b4d7-166ea0d3772f could not be found. May 26 18:08:50.203663 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: action_args: {'id': '99ba7c81-2ccc-489b-b4d7-166ea0d3772f'} May 26 18:08:50.204653 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:08:50.204653 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:50.204653 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:08:50.204653 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:08:50.204653 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:08:50.204653 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:08:50.204653 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:08:50.204653 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:08:50.204653 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:08:50.204653 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:08:50.204653 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99ba7c81-2ccc-489b-b4d7-166ea0d3772f could not be found. May 26 18:08:50.204653 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:08:50.204653 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:50.204653 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:08:50.204653 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:50.204653 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:08:50.204653 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:08:50.204653 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:08:50.204653 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:08:50.204653 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:08:50.207035 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:08:50.207035 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 18:08:50.207035 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 18:08:50.207035 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 18:08:50.207035 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 18:08:50.207035 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:08:50.207035 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:08:50.207035 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:08:50.207035 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:08:50.207035 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99ba7c81-2ccc-489b-b4d7-166ea0d3772f could not be found. May 26 18:08:50.207035 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:08:50.207035 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:50.207035 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:08:50.207035 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:50.207035 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:08:50.207035 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:08:50.207035 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:08:50.207035 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:08:50.207035 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99ba7c81-2ccc-489b-b4d7-166ea0d3772f could not be found. May 26 18:08:50.207035 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:08:50.208621 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-84a83bd6-bb2c-4742-ae2f-c6db2511d88f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Returning 404 to user: Instance 99ba7c81-2ccc-489b-b4d7-166ea0d3772f could not be found. {{(pid=117722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:08:50.208621 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-84a83bd6-bb2c-4742-ae2f-c6db2511d88f tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "DELETE /compute/v2.1/servers/99ba7c81-2ccc-489b-b4d7-166ea0d3772f" status: 404 len: 111 microversion: 2.1 time: 0.035211 May 26 18:08:50.208621 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 491/952] 10.222.0.69 () {58 vars in 1238 bytes} [Thu May 26 18:08:50 2022] DELETE /compute/v2.1/servers/99ba7c81-2ccc-489b-b4d7-166ea0d3772f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:08:50.212204 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-55d0d897-34a2-476b-8da8-33ac27b354d4 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:50.213147 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-55d0d897-34a2-476b-8da8-33ac27b354d4 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 99ba7c81-2ccc-489b-b4d7-166ea0d3772f] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:50.219905 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-55d0d897-34a2-476b-8da8-33ac27b354d4 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:50.220660 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-55d0d897-34a2-476b-8da8-33ac27b354d4 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:50.221533 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-55d0d897-34a2-476b-8da8-33ac27b354d4 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:50.224703 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-55d0d897-34a2-476b-8da8-33ac27b354d4 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:50.224851 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-3f9e3f34-be91-4a07-8344-52631783c9a2 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Flavor limits 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:08:50.224851 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-3f9e3f34-be91-4a07-8344-52631783c9a2 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Image limits 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:08:50.224851 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-3f9e3f34-be91-4a07-8344-52631783c9a2 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Flavor pref 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:08:50.224851 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-3f9e3f34-be91-4a07-8344-52631783c9a2 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Image pref 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:08:50.224851 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-3f9e3f34-be91-4a07-8344-52631783c9a2 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:08:50.234064 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3f9e3f34-be91-4a07-8344-52631783c9a2 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:50.234605 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3f9e3f34-be91-4a07-8344-52631783c9a2 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:50.236311 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3f9e3f34-be91-4a07-8344-52631783c9a2 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:50.237607 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3f9e3f34-be91-4a07-8344-52631783c9a2 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:50.245999 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.wsgi [None req-55d0d897-34a2-476b-8da8-33ac27b354d4 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] HTTP exception thrown: Instance 99ba7c81-2ccc-489b-b4d7-166ea0d3772f could not be found. May 26 18:08:50.247526 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-55d0d897-34a2-476b-8da8-33ac27b354d4 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Request method failure captured: May 26 18:08:50.247526 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: request: GET /compute/v2.1/servers/99ba7c81-2ccc-489b-b4d7-166ea0d3772f HTTP/1.1 May 26 18:08:50.247526 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Accept: application/json May 26 18:08:50.247526 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Accept-Encoding: identity May 26 18:08:50.247526 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Connection: close May 26 18:08:50.247526 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Content-Length: 0 May 26 18:08:50.247526 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Content-Type: application/json May 26 18:08:50.247526 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Host: 10.222.0.69 May 26 18:08:50.247526 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Openstack-System-Scope: None May 26 18:08:50.247526 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: User-Agent: python-urllib3/1.26.9 May 26 18:08:50.247526 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Auth-Token: gAAAAABij8DD0GGF2lSLDsyvjDvkvKuYTmd8MhBJFcuAgLQjYIxaUzVYvy2y78Ufugs1Oc4LrOO28-M4MWgXvAjDAFM656TsVGzxmhayY-bOw7ExJ5yRcG231tnUdWRr6zrbitvFAB7wzSB1IdWp2Auh8VsxEfhGR0YnizUXC6yVsCWiAksLALA May 26 18:08:50.247526 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Domain-Id: None May 26 18:08:50.247526 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Domain-Name: None May 26 18:08:50.247526 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Identity-Status: Confirmed May 26 18:08:50.247526 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Is-Admin-Project: True May 26 18:08:50.247526 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Domain-Id: default May 26 18:08:50.247526 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Domain-Name: Default May 26 18:08:50.247526 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Id: 8920d2de9dc34386bb0e770f5b51b702 May 26 18:08:50.247526 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Name: tempest-AttachVolumeNegativeTest-2031663802 May 26 18:08:50.247526 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Role: member,reader May 26 18:08:50.247526 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Roles: member,reader May 26 18:08:50.249062 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8920d2de9dc34386bb0e770f5b51b702"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8920d2de9dc34386bb0e770f5b51b702"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8920d2de9dc34386bb0e770f5b51b702"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8920d2de9dc34386bb0e770f5b51b702"}]}] May 26 18:08:50.249062 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant: tempest-AttachVolumeNegativeTest-2031663802 May 26 18:08:50.249062 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant-Id: 8920d2de9dc34386bb0e770f5b51b702 May 26 18:08:50.249062 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2031663802 May 26 18:08:50.249062 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User: tempest-AttachVolumeNegativeTest-2031663802-project May 26 18:08:50.249062 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Domain-Id: default May 26 18:08:50.249062 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Domain-Name: Default May 26 18:08:50.249062 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Id: 2691e1dc96e942b5ba4c726b72a835e9 May 26 18:08:50.249062 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Name: tempest-AttachVolumeNegativeTest-2031663802-project May 26 18:08:50.249062 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: method: > May 26 18:08:50.249062 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: exception: Instance 99ba7c81-2ccc-489b-b4d7-166ea0d3772f could not be found. May 26 18:08:50.249062 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: action_args: {'id': '99ba7c81-2ccc-489b-b4d7-166ea0d3772f'} May 26 18:08:50.249916 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:08:50.249916 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:50.249916 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:08:50.249916 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:08:50.249916 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:08:50.249916 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:08:50.249916 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:08:50.249916 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:08:50.249916 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:08:50.249916 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:08:50.249916 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99ba7c81-2ccc-489b-b4d7-166ea0d3772f could not be found. May 26 18:08:50.249916 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:08:50.249916 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:50.249916 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:08:50.249916 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:50.249916 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:08:50.249916 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:08:50.249916 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:08:50.249916 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:08:50.249916 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:08:50.251289 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:08:50.251289 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:08:50.251289 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:08:50.251289 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:08:50.251289 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:08:50.251289 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:08:50.251289 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:08:50.251289 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99ba7c81-2ccc-489b-b4d7-166ea0d3772f could not be found. May 26 18:08:50.251289 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:08:50.251289 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:50.251289 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:08:50.251289 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:50.251289 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:08:50.251289 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:08:50.251289 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:08:50.251289 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:08:50.251289 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99ba7c81-2ccc-489b-b4d7-166ea0d3772f could not be found. May 26 18:08:50.251289 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:08:50.254031 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-55d0d897-34a2-476b-8da8-33ac27b354d4 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Returning 404 to user: Instance 99ba7c81-2ccc-489b-b4d7-166ea0d3772f could not be found. {{(pid=117722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:08:50.254031 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-55d0d897-34a2-476b-8da8-33ac27b354d4 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/99ba7c81-2ccc-489b-b4d7-166ea0d3772f" status: 404 len: 111 microversion: 2.1 time: 0.042642 May 26 18:08:50.254031 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 492/953] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:08:50 2022] GET /compute/v2.1/servers/99ba7c81-2ccc-489b-b4d7-166ea0d3772f => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:08:50.255952 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-3f9e3f34-be91-4a07-8344-52631783c9a2 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Getting quotas for project f6805a7efbeb448d8bc42a86ff756071. Resources: {'instances', 'ram', 'cores'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:08:50.260781 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-3f9e3f34-be91-4a07-8344-52631783c9a2 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Getting quotas for user 6ab7e96c0db34764bc2ac1e20d0ac35e and project f6805a7efbeb448d8bc42a86ff756071. Resources: {'instances', 'ram', 'cores'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:08:50.274636 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-3f9e3f34-be91-4a07-8344-52631783c9a2 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Going to run 1 instances... {{(pid=117723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:08:50.277080 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-3f9e3f34-be91-4a07-8344-52631783c9a2 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] [instance: 27142015-9fcb-4e3e-802d-f687fda3c961] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='16351c96-cb02-4711-99d5-fd4d80e8a846',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:08:50.334440 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-3f9e3f34-be91-4a07-8344-52631783c9a2 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.580950 May 26 18:08:50.335109 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 462/954] 10.222.0.69 () {60 vars in 1146 bytes} [Thu May 26 18:08:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 26 18:08:50.352808 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-63c21c1f-3ba5-4206-8a94-21f04449ecc5 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:50.353589 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-63c21c1f-3ba5-4206-8a94-21f04449ecc5 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] [instance: 27142015-9fcb-4e3e-802d-f687fda3c961] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:50.436365 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-63c21c1f-3ba5-4206-8a94-21f04449ecc5 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab7e96c0db34764bc2ac1e20d0ac35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6805a7efbeb448d8bc42a86ff756071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:50.450607 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-63c21c1f-3ba5-4206-8a94-21f04449ecc5 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] 10.222.0.69 "GET /compute/v2.1/servers/27142015-9fcb-4e3e-802d-f687fda3c961" status: 200 len: 1213 microversion: 2.1 time: 0.106716 May 26 18:08:50.451653 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 493/955] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:08:50 2022] GET /compute/v2.1/servers/27142015-9fcb-4e3e-802d-f687fda3c961 => generated 1213 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:51.028978 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-0dae818a-e663-4603-b43e-66bc37683338 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:51.029942 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-0dae818a-e663-4603-b43e-66bc37683338 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: e8ab62c1-6839-4a58-9dd4-848eed83661c] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:51.041282 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0dae818a-e663-4603-b43e-66bc37683338 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:51.042197 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0dae818a-e663-4603-b43e-66bc37683338 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:51.042929 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0dae818a-e663-4603-b43e-66bc37683338 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:51.043435 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0dae818a-e663-4603-b43e-66bc37683338 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:51.238263 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:51.380919 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-0dae818a-e663-4603-b43e-66bc37683338 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683ec43ae844757883a7dd5003b53d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a75cf80284f58b9c3bed674677a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:51.390979 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-0dae818a-e663-4603-b43e-66bc37683338 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "GET /compute/v2.1/servers/e8ab62c1-6839-4a58-9dd4-848eed83661c" status: 200 len: 1264 microversion: 2.1 time: 0.367817 May 26 18:08:51.392589 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 463/956] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:08:51 2022] GET /compute/v2.1/servers/e8ab62c1-6839-4a58-9dd4-848eed83661c => generated 1264 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:08:51.409003 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-670d79dc-f87a-413f-bce1-23f5a11b9787 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:51.409543 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-670d79dc-f87a-413f-bce1-23f5a11b9787 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 8a2d2dde-ab10-41d4-ab33-ad703f697b84] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:51.418656 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-670d79dc-f87a-413f-bce1-23f5a11b9787 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:51.419208 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-670d79dc-f87a-413f-bce1-23f5a11b9787 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:51.420453 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-670d79dc-f87a-413f-bce1-23f5a11b9787 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:51.420979 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-670d79dc-f87a-413f-bce1-23f5a11b9787 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:51.438552 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.wsgi [None req-670d79dc-f87a-413f-bce1-23f5a11b9787 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] HTTP exception thrown: Instance 8a2d2dde-ab10-41d4-ab33-ad703f697b84 could not be found. May 26 18:08:51.441329 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-670d79dc-f87a-413f-bce1-23f5a11b9787 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Request method failure captured: May 26 18:08:51.441329 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: request: DELETE /compute/v2.1/servers/8a2d2dde-ab10-41d4-ab33-ad703f697b84 HTTP/1.1 May 26 18:08:51.441329 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Accept: application/json May 26 18:08:51.441329 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Accept-Encoding: identity May 26 18:08:51.441329 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Connection: close May 26 18:08:51.441329 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Content-Length: 0 May 26 18:08:51.441329 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Content-Type: application/json May 26 18:08:51.441329 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Host: 10.222.0.69 May 26 18:08:51.441329 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Openstack-System-Scope: None May 26 18:08:51.441329 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: User-Agent: python-urllib3/1.26.9 May 26 18:08:51.441329 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Auth-Token: gAAAAABij8DD0GGF2lSLDsyvjDvkvKuYTmd8MhBJFcuAgLQjYIxaUzVYvy2y78Ufugs1Oc4LrOO28-M4MWgXvAjDAFM656TsVGzxmhayY-bOw7ExJ5yRcG231tnUdWRr6zrbitvFAB7wzSB1IdWp2Auh8VsxEfhGR0YnizUXC6yVsCWiAksLALA May 26 18:08:51.441329 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Domain-Id: None May 26 18:08:51.441329 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Domain-Name: None May 26 18:08:51.441329 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Identity-Status: Confirmed May 26 18:08:51.441329 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Is-Admin-Project: True May 26 18:08:51.441329 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Domain-Id: default May 26 18:08:51.441329 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Domain-Name: Default May 26 18:08:51.441329 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Id: 8920d2de9dc34386bb0e770f5b51b702 May 26 18:08:51.441329 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Name: tempest-AttachVolumeNegativeTest-2031663802 May 26 18:08:51.441329 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Role: member,reader May 26 18:08:51.441329 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Roles: member,reader May 26 18:08:51.443743 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8920d2de9dc34386bb0e770f5b51b702"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8920d2de9dc34386bb0e770f5b51b702"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8920d2de9dc34386bb0e770f5b51b702"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8920d2de9dc34386bb0e770f5b51b702"}]}] May 26 18:08:51.443743 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant: tempest-AttachVolumeNegativeTest-2031663802 May 26 18:08:51.443743 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant-Id: 8920d2de9dc34386bb0e770f5b51b702 May 26 18:08:51.443743 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2031663802 May 26 18:08:51.443743 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User: tempest-AttachVolumeNegativeTest-2031663802-project May 26 18:08:51.443743 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Domain-Id: default May 26 18:08:51.443743 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Domain-Name: Default May 26 18:08:51.443743 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Id: 2691e1dc96e942b5ba4c726b72a835e9 May 26 18:08:51.443743 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Name: tempest-AttachVolumeNegativeTest-2031663802-project May 26 18:08:51.443743 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: method: > May 26 18:08:51.443743 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: exception: Instance 8a2d2dde-ab10-41d4-ab33-ad703f697b84 could not be found. May 26 18:08:51.443743 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: action_args: {'id': '8a2d2dde-ab10-41d4-ab33-ad703f697b84'} May 26 18:08:51.444800 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:08:51.444800 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:51.444800 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:08:51.444800 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:08:51.444800 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:08:51.444800 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:08:51.444800 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:08:51.444800 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:08:51.444800 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:08:51.444800 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:08:51.444800 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a2d2dde-ab10-41d4-ab33-ad703f697b84 could not be found. May 26 18:08:51.444800 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:08:51.444800 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:51.444800 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:08:51.444800 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:51.444800 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:08:51.444800 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:08:51.444800 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:08:51.444800 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:08:51.444800 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:08:51.446371 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:08:51.446371 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 18:08:51.446371 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 18:08:51.446371 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 18:08:51.446371 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 18:08:51.446371 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:08:51.446371 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:08:51.446371 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:08:51.446371 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:08:51.446371 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a2d2dde-ab10-41d4-ab33-ad703f697b84 could not be found. May 26 18:08:51.446371 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:08:51.446371 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:51.446371 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:08:51.446371 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:51.446371 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:08:51.446371 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:08:51.446371 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:08:51.446371 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:08:51.446371 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a2d2dde-ab10-41d4-ab33-ad703f697b84 could not be found. May 26 18:08:51.446371 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:08:51.448579 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-670d79dc-f87a-413f-bce1-23f5a11b9787 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Returning 404 to user: Instance 8a2d2dde-ab10-41d4-ab33-ad703f697b84 could not be found. {{(pid=117722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:08:51.448579 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-670d79dc-f87a-413f-bce1-23f5a11b9787 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "DELETE /compute/v2.1/servers/8a2d2dde-ab10-41d4-ab33-ad703f697b84" status: 404 len: 111 microversion: 2.1 time: 0.038689 May 26 18:08:51.448579 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 494/957] 10.222.0.69 () {58 vars in 1238 bytes} [Thu May 26 18:08:51 2022] DELETE /compute/v2.1/servers/8a2d2dde-ab10-41d4-ab33-ad703f697b84 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 18:08:51.453858 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-ea3f4731-8f4a-4079-b829-fdad74b02d63 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:51.455081 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-ea3f4731-8f4a-4079-b829-fdad74b02d63 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 8a2d2dde-ab10-41d4-ab33-ad703f697b84] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:51.462747 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ea3f4731-8f4a-4079-b829-fdad74b02d63 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:51.463200 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ea3f4731-8f4a-4079-b829-fdad74b02d63 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:51.466061 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ea3f4731-8f4a-4079-b829-fdad74b02d63 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:51.466543 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ea3f4731-8f4a-4079-b829-fdad74b02d63 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:51.473492 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-d6157b2a-8f0a-4d6c-9c62-1ff8703823bf tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:51.474229 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-d6157b2a-8f0a-4d6c-9c62-1ff8703823bf tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] [instance: 27142015-9fcb-4e3e-802d-f687fda3c961] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:51.481441 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d6157b2a-8f0a-4d6c-9c62-1ff8703823bf tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:51.482356 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d6157b2a-8f0a-4d6c-9c62-1ff8703823bf tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:51.483299 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.wsgi [None req-ea3f4731-8f4a-4079-b829-fdad74b02d63 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] HTTP exception thrown: Instance 8a2d2dde-ab10-41d4-ab33-ad703f697b84 could not be found. May 26 18:08:51.483992 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d6157b2a-8f0a-4d6c-9c62-1ff8703823bf tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:51.484785 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d6157b2a-8f0a-4d6c-9c62-1ff8703823bf tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:51.485007 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-ea3f4731-8f4a-4079-b829-fdad74b02d63 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Request method failure captured: May 26 18:08:51.485007 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: request: GET /compute/v2.1/servers/8a2d2dde-ab10-41d4-ab33-ad703f697b84 HTTP/1.1 May 26 18:08:51.485007 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Accept: application/json May 26 18:08:51.485007 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Accept-Encoding: identity May 26 18:08:51.485007 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Connection: close May 26 18:08:51.485007 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Content-Length: 0 May 26 18:08:51.485007 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Content-Type: application/json May 26 18:08:51.485007 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Host: 10.222.0.69 May 26 18:08:51.485007 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Openstack-System-Scope: None May 26 18:08:51.485007 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: User-Agent: python-urllib3/1.26.9 May 26 18:08:51.485007 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Auth-Token: gAAAAABij8DD0GGF2lSLDsyvjDvkvKuYTmd8MhBJFcuAgLQjYIxaUzVYvy2y78Ufugs1Oc4LrOO28-M4MWgXvAjDAFM656TsVGzxmhayY-bOw7ExJ5yRcG231tnUdWRr6zrbitvFAB7wzSB1IdWp2Auh8VsxEfhGR0YnizUXC6yVsCWiAksLALA May 26 18:08:51.485007 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Domain-Id: None May 26 18:08:51.485007 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Domain-Name: None May 26 18:08:51.485007 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Identity-Status: Confirmed May 26 18:08:51.485007 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Is-Admin-Project: True May 26 18:08:51.485007 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Domain-Id: default May 26 18:08:51.485007 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Domain-Name: Default May 26 18:08:51.485007 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Id: 8920d2de9dc34386bb0e770f5b51b702 May 26 18:08:51.485007 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Name: tempest-AttachVolumeNegativeTest-2031663802 May 26 18:08:51.485007 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Role: member,reader May 26 18:08:51.485007 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Roles: member,reader May 26 18:08:51.486623 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8920d2de9dc34386bb0e770f5b51b702"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8920d2de9dc34386bb0e770f5b51b702"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8920d2de9dc34386bb0e770f5b51b702"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8920d2de9dc34386bb0e770f5b51b702"}]}] May 26 18:08:51.486623 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant: tempest-AttachVolumeNegativeTest-2031663802 May 26 18:08:51.486623 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant-Id: 8920d2de9dc34386bb0e770f5b51b702 May 26 18:08:51.486623 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2031663802 May 26 18:08:51.486623 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User: tempest-AttachVolumeNegativeTest-2031663802-project May 26 18:08:51.486623 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Domain-Id: default May 26 18:08:51.486623 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Domain-Name: Default May 26 18:08:51.486623 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Id: 2691e1dc96e942b5ba4c726b72a835e9 May 26 18:08:51.486623 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Name: tempest-AttachVolumeNegativeTest-2031663802-project May 26 18:08:51.486623 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: method: > May 26 18:08:51.486623 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: exception: Instance 8a2d2dde-ab10-41d4-ab33-ad703f697b84 could not be found. May 26 18:08:51.486623 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: action_args: {'id': '8a2d2dde-ab10-41d4-ab33-ad703f697b84'} May 26 18:08:51.487717 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:08:51.487717 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:51.487717 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:08:51.487717 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:08:51.487717 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:08:51.487717 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:08:51.487717 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:08:51.487717 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:08:51.487717 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:08:51.487717 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:08:51.487717 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a2d2dde-ab10-41d4-ab33-ad703f697b84 could not be found. May 26 18:08:51.487717 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:51.487717 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:51.487717 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:51.487717 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:51.487717 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:08:51.487717 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:08:51.487717 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:08:51.487717 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:08:51.487717 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:08:51.489201 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:08:51.489201 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:08:51.489201 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:08:51.489201 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:08:51.489201 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:08:51.489201 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:08:51.489201 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:08:51.489201 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a2d2dde-ab10-41d4-ab33-ad703f697b84 could not be found. May 26 18:08:51.489201 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:51.489201 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:51.489201 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:51.489201 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:51.489201 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:08:51.489201 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:08:51.489201 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:08:51.489201 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:08:51.489201 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a2d2dde-ab10-41d4-ab33-ad703f697b84 could not be found. May 26 18:08:51.489201 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:51.491188 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-ea3f4731-8f4a-4079-b829-fdad74b02d63 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Returning 404 to user: Instance 8a2d2dde-ab10-41d4-ab33-ad703f697b84 could not be found. {{(pid=117723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:08:51.492263 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-ea3f4731-8f4a-4079-b829-fdad74b02d63 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/8a2d2dde-ab10-41d4-ab33-ad703f697b84" status: 404 len: 111 microversion: 2.1 time: 0.043069 May 26 18:08:51.493184 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 464/958] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:08:51 2022] GET /compute/v2.1/servers/8a2d2dde-ab10-41d4-ab33-ad703f697b84 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:08:51.502525 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-de20896c-064f-4988-b32b-b4d4fdb02ad7 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:51.503165 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-de20896c-064f-4988-b32b-b4d4fdb02ad7 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 6bb99e9b-15af-408e-af01-6e08b8294058] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:51.512347 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-de20896c-064f-4988-b32b-b4d4fdb02ad7 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:51.512811 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-de20896c-064f-4988-b32b-b4d4fdb02ad7 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:51.514365 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-de20896c-064f-4988-b32b-b4d4fdb02ad7 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:51.514831 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-de20896c-064f-4988-b32b-b4d4fdb02ad7 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:51.532147 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.wsgi [None req-de20896c-064f-4988-b32b-b4d4fdb02ad7 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] HTTP exception thrown: Instance 6bb99e9b-15af-408e-af01-6e08b8294058 could not be found. May 26 18:08:51.534543 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-de20896c-064f-4988-b32b-b4d4fdb02ad7 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Request method failure captured: May 26 18:08:51.534543 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: request: DELETE /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058 HTTP/1.1 May 26 18:08:51.534543 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Accept: application/json May 26 18:08:51.534543 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Accept-Encoding: identity May 26 18:08:51.534543 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Connection: close May 26 18:08:51.534543 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Content-Length: 0 May 26 18:08:51.534543 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Content-Type: application/json May 26 18:08:51.534543 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Host: 10.222.0.69 May 26 18:08:51.534543 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Openstack-System-Scope: None May 26 18:08:51.534543 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: User-Agent: python-urllib3/1.26.9 May 26 18:08:51.534543 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Auth-Token: gAAAAABij8DD0GGF2lSLDsyvjDvkvKuYTmd8MhBJFcuAgLQjYIxaUzVYvy2y78Ufugs1Oc4LrOO28-M4MWgXvAjDAFM656TsVGzxmhayY-bOw7ExJ5yRcG231tnUdWRr6zrbitvFAB7wzSB1IdWp2Auh8VsxEfhGR0YnizUXC6yVsCWiAksLALA May 26 18:08:51.534543 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Domain-Id: None May 26 18:08:51.534543 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Domain-Name: None May 26 18:08:51.534543 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Identity-Status: Confirmed May 26 18:08:51.534543 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Is-Admin-Project: True May 26 18:08:51.534543 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Domain-Id: default May 26 18:08:51.534543 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Domain-Name: Default May 26 18:08:51.534543 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Id: 8920d2de9dc34386bb0e770f5b51b702 May 26 18:08:51.534543 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Name: tempest-AttachVolumeNegativeTest-2031663802 May 26 18:08:51.534543 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Role: member,reader May 26 18:08:51.534543 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Roles: member,reader May 26 18:08:51.536156 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8920d2de9dc34386bb0e770f5b51b702"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8920d2de9dc34386bb0e770f5b51b702"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8920d2de9dc34386bb0e770f5b51b702"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8920d2de9dc34386bb0e770f5b51b702"}]}] May 26 18:08:51.536156 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant: tempest-AttachVolumeNegativeTest-2031663802 May 26 18:08:51.536156 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant-Id: 8920d2de9dc34386bb0e770f5b51b702 May 26 18:08:51.536156 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2031663802 May 26 18:08:51.536156 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User: tempest-AttachVolumeNegativeTest-2031663802-project May 26 18:08:51.536156 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Domain-Id: default May 26 18:08:51.536156 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Domain-Name: Default May 26 18:08:51.536156 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Id: 2691e1dc96e942b5ba4c726b72a835e9 May 26 18:08:51.536156 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Name: tempest-AttachVolumeNegativeTest-2031663802-project May 26 18:08:51.536156 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: method: > May 26 18:08:51.536156 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: exception: Instance 6bb99e9b-15af-408e-af01-6e08b8294058 could not be found. May 26 18:08:51.536156 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: action_args: {'id': '6bb99e9b-15af-408e-af01-6e08b8294058'} May 26 18:08:51.537033 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:08:51.537033 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:51.537033 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:08:51.537033 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:08:51.537033 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:08:51.537033 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:08:51.537033 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:08:51.537033 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:08:51.537033 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:08:51.537033 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:08:51.537033 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bb99e9b-15af-408e-af01-6e08b8294058 could not be found. May 26 18:08:51.537033 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:51.537033 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:51.537033 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:51.537033 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:51.537033 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:08:51.537033 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:08:51.537033 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:08:51.537033 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:08:51.537033 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:08:51.538522 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:08:51.538522 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 18:08:51.538522 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 18:08:51.538522 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 18:08:51.538522 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 18:08:51.538522 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:08:51.538522 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:08:51.538522 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:08:51.538522 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:08:51.538522 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bb99e9b-15af-408e-af01-6e08b8294058 could not be found. May 26 18:08:51.538522 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:51.538522 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:51.538522 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:51.538522 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:51.538522 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:08:51.538522 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:08:51.538522 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:08:51.538522 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:08:51.538522 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bb99e9b-15af-408e-af01-6e08b8294058 could not be found. May 26 18:08:51.538522 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:51.539910 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-de20896c-064f-4988-b32b-b4d4fdb02ad7 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Returning 404 to user: Instance 6bb99e9b-15af-408e-af01-6e08b8294058 could not be found. {{(pid=117723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:08:51.539910 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-de20896c-064f-4988-b32b-b4d4fdb02ad7 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "DELETE /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058" status: 404 len: 111 microversion: 2.1 time: 0.038771 May 26 18:08:51.539910 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 465/959] 10.222.0.69 () {58 vars in 1238 bytes} [Thu May 26 18:08:51 2022] DELETE /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:08:51.544756 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-0085ccd0-b2d6-4691-9797-86a857eed8c8 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:51.545570 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-0085ccd0-b2d6-4691-9797-86a857eed8c8 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: 6bb99e9b-15af-408e-af01-6e08b8294058] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:51.553083 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0085ccd0-b2d6-4691-9797-86a857eed8c8 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:51.553580 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0085ccd0-b2d6-4691-9797-86a857eed8c8 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:51.554604 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0085ccd0-b2d6-4691-9797-86a857eed8c8 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:51.555303 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0085ccd0-b2d6-4691-9797-86a857eed8c8 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:51.571850 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.wsgi [None req-0085ccd0-b2d6-4691-9797-86a857eed8c8 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] HTTP exception thrown: Instance 6bb99e9b-15af-408e-af01-6e08b8294058 could not be found. May 26 18:08:51.573434 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-0085ccd0-b2d6-4691-9797-86a857eed8c8 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Request method failure captured: May 26 18:08:51.573434 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: request: GET /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058 HTTP/1.1 May 26 18:08:51.573434 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Accept: application/json May 26 18:08:51.573434 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Accept-Encoding: identity May 26 18:08:51.573434 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Connection: close May 26 18:08:51.573434 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Content-Length: 0 May 26 18:08:51.573434 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Content-Type: application/json May 26 18:08:51.573434 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Host: 10.222.0.69 May 26 18:08:51.573434 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Openstack-System-Scope: None May 26 18:08:51.573434 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: User-Agent: python-urllib3/1.26.9 May 26 18:08:51.573434 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Auth-Token: gAAAAABij8DD0GGF2lSLDsyvjDvkvKuYTmd8MhBJFcuAgLQjYIxaUzVYvy2y78Ufugs1Oc4LrOO28-M4MWgXvAjDAFM656TsVGzxmhayY-bOw7ExJ5yRcG231tnUdWRr6zrbitvFAB7wzSB1IdWp2Auh8VsxEfhGR0YnizUXC6yVsCWiAksLALA May 26 18:08:51.573434 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Domain-Id: None May 26 18:08:51.573434 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Domain-Name: None May 26 18:08:51.573434 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Identity-Status: Confirmed May 26 18:08:51.573434 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Is-Admin-Project: True May 26 18:08:51.573434 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Domain-Id: default May 26 18:08:51.573434 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Domain-Name: Default May 26 18:08:51.573434 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Id: 8920d2de9dc34386bb0e770f5b51b702 May 26 18:08:51.573434 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Name: tempest-AttachVolumeNegativeTest-2031663802 May 26 18:08:51.573434 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Role: member,reader May 26 18:08:51.573434 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Roles: member,reader May 26 18:08:51.575022 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8920d2de9dc34386bb0e770f5b51b702"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8920d2de9dc34386bb0e770f5b51b702"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8920d2de9dc34386bb0e770f5b51b702"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8920d2de9dc34386bb0e770f5b51b702"}]}] May 26 18:08:51.575022 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant: tempest-AttachVolumeNegativeTest-2031663802 May 26 18:08:51.575022 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant-Id: 8920d2de9dc34386bb0e770f5b51b702 May 26 18:08:51.575022 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2031663802 May 26 18:08:51.575022 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User: tempest-AttachVolumeNegativeTest-2031663802-project May 26 18:08:51.575022 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Domain-Id: default May 26 18:08:51.575022 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Domain-Name: Default May 26 18:08:51.575022 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Id: 2691e1dc96e942b5ba4c726b72a835e9 May 26 18:08:51.575022 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Name: tempest-AttachVolumeNegativeTest-2031663802-project May 26 18:08:51.575022 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: method: > May 26 18:08:51.575022 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: exception: Instance 6bb99e9b-15af-408e-af01-6e08b8294058 could not be found. May 26 18:08:51.575022 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: action_args: {'id': '6bb99e9b-15af-408e-af01-6e08b8294058'} May 26 18:08:51.576282 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:08:51.576282 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:51.576282 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:08:51.576282 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:08:51.576282 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:08:51.576282 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:08:51.576282 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:08:51.576282 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:08:51.576282 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:08:51.576282 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:08:51.576282 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bb99e9b-15af-408e-af01-6e08b8294058 could not be found. May 26 18:08:51.576282 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:51.576282 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:51.576282 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:51.576282 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:51.576282 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:08:51.576282 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:08:51.576282 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:08:51.576282 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:08:51.576282 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:08:51.577795 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:08:51.577795 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:08:51.577795 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:08:51.577795 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:08:51.577795 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:08:51.577795 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:08:51.577795 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:08:51.577795 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bb99e9b-15af-408e-af01-6e08b8294058 could not be found. May 26 18:08:51.577795 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:51.577795 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:51.577795 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:51.577795 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:51.577795 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:08:51.577795 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:08:51.577795 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:08:51.577795 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:08:51.577795 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bb99e9b-15af-408e-af01-6e08b8294058 could not be found. May 26 18:08:51.577795 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:51.579161 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-0085ccd0-b2d6-4691-9797-86a857eed8c8 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Returning 404 to user: Instance 6bb99e9b-15af-408e-af01-6e08b8294058 could not be found. {{(pid=117723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:08:51.579161 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-0085ccd0-b2d6-4691-9797-86a857eed8c8 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058" status: 404 len: 111 microversion: 2.1 time: 0.034190 May 26 18:08:51.579161 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 466/960] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:08:51 2022] GET /compute/v2.1/servers/6bb99e9b-15af-408e-af01-6e08b8294058 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:08:51.614401 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-d6157b2a-8f0a-4d6c-9c62-1ff8703823bf tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab7e96c0db34764bc2ac1e20d0ac35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6805a7efbeb448d8bc42a86ff756071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:51.624203 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-d6157b2a-8f0a-4d6c-9c62-1ff8703823bf tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] 10.222.0.69 "GET /compute/v2.1/servers/27142015-9fcb-4e3e-802d-f687fda3c961" status: 200 len: 1283 microversion: 2.1 time: 0.157087 May 26 18:08:51.624805 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 495/961] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:08:51 2022] GET /compute/v2.1/servers/27142015-9fcb-4e3e-802d-f687fda3c961 => generated 1283 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:52.409706 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-f4d9211f-ffb9-45b4-ba7b-9f657f098011 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:52.411025 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-f4d9211f-ffb9-45b4-ba7b-9f657f098011 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: e8ab62c1-6839-4a58-9dd4-848eed83661c] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:52.418721 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f4d9211f-ffb9-45b4-ba7b-9f657f098011 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:52.419583 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f4d9211f-ffb9-45b4-ba7b-9f657f098011 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:52.420684 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f4d9211f-ffb9-45b4-ba7b-9f657f098011 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:52.421132 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f4d9211f-ffb9-45b4-ba7b-9f657f098011 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:52.568853 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-f4d9211f-ffb9-45b4-ba7b-9f657f098011 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683ec43ae844757883a7dd5003b53d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a75cf80284f58b9c3bed674677a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:52.579008 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-f4d9211f-ffb9-45b4-ba7b-9f657f098011 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "GET /compute/v2.1/servers/e8ab62c1-6839-4a58-9dd4-848eed83661c" status: 200 len: 1264 microversion: 2.1 time: 0.174115 May 26 18:08:52.579591 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 467/962] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:08:52 2022] GET /compute/v2.1/servers/e8ab62c1-6839-4a58-9dd4-848eed83661c => generated 1264 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:52.643185 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-aefba5e3-abf9-4124-b750-6bab97ccb34e tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:52.643898 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-aefba5e3-abf9-4124-b750-6bab97ccb34e tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] [instance: 27142015-9fcb-4e3e-802d-f687fda3c961] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:52.650861 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-aefba5e3-abf9-4124-b750-6bab97ccb34e tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:52.651379 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-aefba5e3-abf9-4124-b750-6bab97ccb34e tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:52.652257 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-aefba5e3-abf9-4124-b750-6bab97ccb34e tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:52.652766 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-aefba5e3-abf9-4124-b750-6bab97ccb34e tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:52.674285 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:52.735502 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-9a07fc8c-3388-40dd-93c3-3d1a33bad31c tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:52.736248 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-9a07fc8c-3388-40dd-93c3-3d1a33bad31c tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:52.742691 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9a07fc8c-3388-40dd-93c3-3d1a33bad31c tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:52.743221 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9a07fc8c-3388-40dd-93c3-3d1a33bad31c tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:52.744089 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9a07fc8c-3388-40dd-93c3-3d1a33bad31c tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:52.744593 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9a07fc8c-3388-40dd-93c3-3d1a33bad31c tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:52.760334 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.wsgi [None req-9a07fc8c-3388-40dd-93c3-3d1a33bad31c tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] HTTP exception thrown: Instance fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7 could not be found. May 26 18:08:52.761974 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-9a07fc8c-3388-40dd-93c3-3d1a33bad31c tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Request method failure captured: May 26 18:08:52.761974 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: request: DELETE /compute/v2.1/servers/fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7 HTTP/1.1 May 26 18:08:52.761974 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Accept: application/json May 26 18:08:52.761974 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Accept-Encoding: identity May 26 18:08:52.761974 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Connection: close May 26 18:08:52.761974 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Content-Length: 0 May 26 18:08:52.761974 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Content-Type: application/json May 26 18:08:52.761974 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Host: 10.222.0.69 May 26 18:08:52.761974 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Openstack-System-Scope: None May 26 18:08:52.761974 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: User-Agent: python-urllib3/1.26.9 May 26 18:08:52.761974 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Auth-Token: gAAAAABij8DD0GGF2lSLDsyvjDvkvKuYTmd8MhBJFcuAgLQjYIxaUzVYvy2y78Ufugs1Oc4LrOO28-M4MWgXvAjDAFM656TsVGzxmhayY-bOw7ExJ5yRcG231tnUdWRr6zrbitvFAB7wzSB1IdWp2Auh8VsxEfhGR0YnizUXC6yVsCWiAksLALA May 26 18:08:52.761974 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Domain-Id: None May 26 18:08:52.761974 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Domain-Name: None May 26 18:08:52.761974 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Identity-Status: Confirmed May 26 18:08:52.761974 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Is-Admin-Project: True May 26 18:08:52.761974 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Domain-Id: default May 26 18:08:52.761974 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Domain-Name: Default May 26 18:08:52.761974 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Id: 8920d2de9dc34386bb0e770f5b51b702 May 26 18:08:52.761974 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Name: tempest-AttachVolumeNegativeTest-2031663802 May 26 18:08:52.761974 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Role: member,reader May 26 18:08:52.761974 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Roles: member,reader May 26 18:08:52.763622 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8920d2de9dc34386bb0e770f5b51b702"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8920d2de9dc34386bb0e770f5b51b702"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8920d2de9dc34386bb0e770f5b51b702"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8920d2de9dc34386bb0e770f5b51b702"}]}] May 26 18:08:52.763622 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant: tempest-AttachVolumeNegativeTest-2031663802 May 26 18:08:52.763622 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant-Id: 8920d2de9dc34386bb0e770f5b51b702 May 26 18:08:52.763622 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2031663802 May 26 18:08:52.763622 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User: tempest-AttachVolumeNegativeTest-2031663802-project May 26 18:08:52.763622 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Domain-Id: default May 26 18:08:52.763622 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Domain-Name: Default May 26 18:08:52.763622 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Id: 2691e1dc96e942b5ba4c726b72a835e9 May 26 18:08:52.763622 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Name: tempest-AttachVolumeNegativeTest-2031663802-project May 26 18:08:52.763622 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: method: > May 26 18:08:52.763622 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: exception: Instance fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7 could not be found. May 26 18:08:52.763622 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: action_args: {'id': 'fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7'} May 26 18:08:52.764661 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:08:52.764661 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:52.764661 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:08:52.764661 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:08:52.764661 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:08:52.764661 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:08:52.764661 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:08:52.764661 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:08:52.764661 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:08:52.764661 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:08:52.764661 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7 could not be found. May 26 18:08:52.764661 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:52.764661 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:52.764661 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:52.764661 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:52.764661 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:08:52.764661 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:08:52.764661 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:08:52.764661 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:08:52.764661 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:08:52.765908 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:08:52.765908 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 18:08:52.765908 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 18:08:52.765908 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 18:08:52.765908 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 18:08:52.765908 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:08:52.765908 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:08:52.765908 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:08:52.765908 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:08:52.765908 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7 could not be found. May 26 18:08:52.765908 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:52.765908 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:52.765908 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:52.765908 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:52.765908 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:08:52.765908 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:08:52.765908 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:08:52.765908 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:08:52.765908 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7 could not be found. May 26 18:08:52.765908 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:52.767226 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-9a07fc8c-3388-40dd-93c3-3d1a33bad31c tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Returning 404 to user: Instance fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7 could not be found. {{(pid=117723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:08:52.767226 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-9a07fc8c-3388-40dd-93c3-3d1a33bad31c tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "DELETE /compute/v2.1/servers/fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7" status: 404 len: 111 microversion: 2.1 time: 0.031833 May 26 18:08:52.767226 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 468/963] 10.222.0.69 () {58 vars in 1238 bytes} [Thu May 26 18:08:52 2022] DELETE /compute/v2.1/servers/fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 18:08:52.773375 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-4bceb9b0-72a3-498b-b5f9-9895b3752855 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:52.773932 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-4bceb9b0-72a3-498b-b5f9-9895b3752855 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] [instance: fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:52.780051 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4bceb9b0-72a3-498b-b5f9-9895b3752855 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:52.780433 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4bceb9b0-72a3-498b-b5f9-9895b3752855 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:52.781210 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4bceb9b0-72a3-498b-b5f9-9895b3752855 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:52.781651 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4bceb9b0-72a3-498b-b5f9-9895b3752855 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:52.796423 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.wsgi [None req-4bceb9b0-72a3-498b-b5f9-9895b3752855 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] HTTP exception thrown: Instance fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7 could not be found. May 26 18:08:52.798166 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-4bceb9b0-72a3-498b-b5f9-9895b3752855 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Request method failure captured: May 26 18:08:52.798166 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: request: GET /compute/v2.1/servers/fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7 HTTP/1.1 May 26 18:08:52.798166 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Accept: application/json May 26 18:08:52.798166 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Accept-Encoding: identity May 26 18:08:52.798166 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Connection: close May 26 18:08:52.798166 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Content-Length: 0 May 26 18:08:52.798166 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Content-Type: application/json May 26 18:08:52.798166 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Host: 10.222.0.69 May 26 18:08:52.798166 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Openstack-System-Scope: None May 26 18:08:52.798166 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: User-Agent: python-urllib3/1.26.9 May 26 18:08:52.798166 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Auth-Token: gAAAAABij8DD0GGF2lSLDsyvjDvkvKuYTmd8MhBJFcuAgLQjYIxaUzVYvy2y78Ufugs1Oc4LrOO28-M4MWgXvAjDAFM656TsVGzxmhayY-bOw7ExJ5yRcG231tnUdWRr6zrbitvFAB7wzSB1IdWp2Auh8VsxEfhGR0YnizUXC6yVsCWiAksLALA May 26 18:08:52.798166 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Domain-Id: None May 26 18:08:52.798166 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Domain-Name: None May 26 18:08:52.798166 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Identity-Status: Confirmed May 26 18:08:52.798166 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Is-Admin-Project: True May 26 18:08:52.798166 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Domain-Id: default May 26 18:08:52.798166 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Domain-Name: Default May 26 18:08:52.798166 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Id: 8920d2de9dc34386bb0e770f5b51b702 May 26 18:08:52.798166 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Name: tempest-AttachVolumeNegativeTest-2031663802 May 26 18:08:52.798166 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Role: member,reader May 26 18:08:52.798166 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Roles: member,reader May 26 18:08:52.800430 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8920d2de9dc34386bb0e770f5b51b702"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8920d2de9dc34386bb0e770f5b51b702"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8920d2de9dc34386bb0e770f5b51b702"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8920d2de9dc34386bb0e770f5b51b702"}]}] May 26 18:08:52.800430 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant: tempest-AttachVolumeNegativeTest-2031663802 May 26 18:08:52.800430 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant-Id: 8920d2de9dc34386bb0e770f5b51b702 May 26 18:08:52.800430 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2031663802 May 26 18:08:52.800430 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User: tempest-AttachVolumeNegativeTest-2031663802-project May 26 18:08:52.800430 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Domain-Id: default May 26 18:08:52.800430 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Domain-Name: Default May 26 18:08:52.800430 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Id: 2691e1dc96e942b5ba4c726b72a835e9 May 26 18:08:52.800430 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Name: tempest-AttachVolumeNegativeTest-2031663802-project May 26 18:08:52.800430 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: method: > May 26 18:08:52.800430 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: exception: Instance fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7 could not be found. May 26 18:08:52.800430 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: action_args: {'id': 'fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7'} May 26 18:08:52.801394 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:08:52.801394 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:52.801394 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:08:52.801394 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:08:52.801394 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:08:52.801394 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:08:52.801394 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:08:52.801394 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:08:52.801394 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:08:52.801394 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:08:52.801394 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7 could not be found. May 26 18:08:52.801394 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:52.801394 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:52.801394 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:52.801394 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:52.801394 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:08:52.801394 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:08:52.801394 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:08:52.801394 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:08:52.801394 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:08:52.803202 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:08:52.803202 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:08:52.803202 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:08:52.803202 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:08:52.803202 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:08:52.803202 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:08:52.803202 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:08:52.803202 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7 could not be found. May 26 18:08:52.803202 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:52.803202 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:52.803202 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:52.803202 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:52.803202 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:08:52.803202 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:08:52.803202 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:08:52.803202 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:08:52.803202 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7 could not be found. May 26 18:08:52.803202 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:08:52.805424 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-4bceb9b0-72a3-498b-b5f9-9895b3752855 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] Returning 404 to user: Instance fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7 could not be found. {{(pid=117723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:08:52.805424 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-4bceb9b0-72a3-498b-b5f9-9895b3752855 tempest-AttachVolumeNegativeTest-2031663802 tempest-AttachVolumeNegativeTest-2031663802-project] 10.222.0.69 "GET /compute/v2.1/servers/fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7" status: 404 len: 111 microversion: 2.1 time: 0.030064 May 26 18:08:52.805424 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 469/964] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:08:52 2022] GET /compute/v2.1/servers/fdbe0b4e-95f0-4baf-a521-e6a8dd57cfc7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 18:08:52.860749 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-aefba5e3-abf9-4124-b750-6bab97ccb34e tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab7e96c0db34764bc2ac1e20d0ac35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6805a7efbeb448d8bc42a86ff756071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:52.871216 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-aefba5e3-abf9-4124-b750-6bab97ccb34e tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] 10.222.0.69 "GET /compute/v2.1/servers/27142015-9fcb-4e3e-802d-f687fda3c961" status: 200 len: 1313 microversion: 2.1 time: 0.231869 May 26 18:08:52.874818 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 496/965] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:08:52 2022] GET /compute/v2.1/servers/27142015-9fcb-4e3e-802d-f687fda3c961 => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:52.951867 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-daea894b-30eb-42fe-845c-6ac724e96a7e req-97810a00-d09a-4639-82e9-fcd40f3056c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27142015-9fcb-4e3e-802d-f687fda3c961", "tag": "4bfc50c2-aad1-4b81-895e-7c92538a1416"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:08:52.961514 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-daea894b-30eb-42fe-845c-6ac724e96a7e req-97810a00-d09a-4639-82e9-fcd40f3056c3 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:52.961933 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-daea894b-30eb-42fe-845c-6ac724e96a7e req-97810a00-d09a-4639-82e9-fcd40f3056c3 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:52.975171 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-daea894b-30eb-42fe-845c-6ac724e96a7e req-97810a00-d09a-4639-82e9-fcd40f3056c3 service nova] Creating event network-changed:4bfc50c2-aad1-4b81-895e-7c92538a1416 for instance 27142015-9fcb-4e3e-802d-f687fda3c961 on hv-cinder-83607 May 26 18:08:52.981621 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-daea894b-30eb-42fe-845c-6ac724e96a7e req-97810a00-d09a-4639-82e9-fcd40f3056c3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033020 May 26 18:08:52.982719 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 470/966] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:08:53.599008 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-d47938be-2fc0-4814-99d6-dc1374397bd3 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:53.600247 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-d47938be-2fc0-4814-99d6-dc1374397bd3 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: e8ab62c1-6839-4a58-9dd4-848eed83661c] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:53.607677 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d47938be-2fc0-4814-99d6-dc1374397bd3 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:53.608314 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d47938be-2fc0-4814-99d6-dc1374397bd3 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:53.609207 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d47938be-2fc0-4814-99d6-dc1374397bd3 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:53.609981 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d47938be-2fc0-4814-99d6-dc1374397bd3 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:53.894455 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-d47938be-2fc0-4814-99d6-dc1374397bd3 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683ec43ae844757883a7dd5003b53d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a75cf80284f58b9c3bed674677a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:53.901267 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-be876247-4082-4752-b42c-fddae0d42c44 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:53.903017 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-d47938be-2fc0-4814-99d6-dc1374397bd3 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "GET /compute/v2.1/servers/e8ab62c1-6839-4a58-9dd4-848eed83661c" status: 200 len: 1264 microversion: 2.1 time: 0.308782 May 26 18:08:53.903657 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-be876247-4082-4752-b42c-fddae0d42c44 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] [instance: 27142015-9fcb-4e3e-802d-f687fda3c961] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:53.909340 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 497/967] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:08:53 2022] GET /compute/v2.1/servers/e8ab62c1-6839-4a58-9dd4-848eed83661c => generated 1264 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:53.916294 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-be876247-4082-4752-b42c-fddae0d42c44 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:53.916755 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-be876247-4082-4752-b42c-fddae0d42c44 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:53.917549 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-be876247-4082-4752-b42c-fddae0d42c44 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:53.917993 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-be876247-4082-4752-b42c-fddae0d42c44 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:54.151021 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-be876247-4082-4752-b42c-fddae0d42c44 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab7e96c0db34764bc2ac1e20d0ac35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6805a7efbeb448d8bc42a86ff756071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:54.160737 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-be876247-4082-4752-b42c-fddae0d42c44 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] 10.222.0.69 "GET /compute/v2.1/servers/27142015-9fcb-4e3e-802d-f687fda3c961" status: 200 len: 1313 microversion: 2.1 time: 0.274358 May 26 18:08:54.161424 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 471/968] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:08:53 2022] GET /compute/v2.1/servers/27142015-9fcb-4e3e-802d-f687fda3c961 => generated 1313 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:54.921456 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-0cf6bd2c-af8e-4a40-98e4-a3581348c312 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:54.922781 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-0cf6bd2c-af8e-4a40-98e4-a3581348c312 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: e8ab62c1-6839-4a58-9dd4-848eed83661c] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:54.933624 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0cf6bd2c-af8e-4a40-98e4-a3581348c312 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:54.934079 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0cf6bd2c-af8e-4a40-98e4-a3581348c312 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:54.934934 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0cf6bd2c-af8e-4a40-98e4-a3581348c312 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:54.935380 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-0cf6bd2c-af8e-4a40-98e4-a3581348c312 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:55.083669 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-0cf6bd2c-af8e-4a40-98e4-a3581348c312 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683ec43ae844757883a7dd5003b53d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a75cf80284f58b9c3bed674677a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:55.091390 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-0cf6bd2c-af8e-4a40-98e4-a3581348c312 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "GET /compute/v2.1/servers/e8ab62c1-6839-4a58-9dd4-848eed83661c" status: 200 len: 1264 microversion: 2.1 time: 0.173998 May 26 18:08:55.091974 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 498/969] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:08:54 2022] GET /compute/v2.1/servers/e8ab62c1-6839-4a58-9dd4-848eed83661c => generated 1264 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:55.178215 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-05f48f5b-a271-448b-b594-89243abd9681 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:55.178874 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-05f48f5b-a271-448b-b594-89243abd9681 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] [instance: 27142015-9fcb-4e3e-802d-f687fda3c961] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:55.185801 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-05f48f5b-a271-448b-b594-89243abd9681 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:55.186268 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-05f48f5b-a271-448b-b594-89243abd9681 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:55.187050 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-05f48f5b-a271-448b-b594-89243abd9681 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:55.187491 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-05f48f5b-a271-448b-b594-89243abd9681 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:55.360561 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-05f48f5b-a271-448b-b594-89243abd9681 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab7e96c0db34764bc2ac1e20d0ac35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6805a7efbeb448d8bc42a86ff756071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:55.383287 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-05f48f5b-a271-448b-b594-89243abd9681 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] 10.222.0.69 "GET /compute/v2.1/servers/27142015-9fcb-4e3e-802d-f687fda3c961" status: 200 len: 1313 microversion: 2.1 time: 0.209193 May 26 18:08:55.393142 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 472/970] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:08:55 2022] GET /compute/v2.1/servers/27142015-9fcb-4e3e-802d-f687fda3c961 => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:56.118855 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-e64d22e7-23ba-40d2-9874-fe7e95221134 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:56.121147 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-e64d22e7-23ba-40d2-9874-fe7e95221134 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: e8ab62c1-6839-4a58-9dd4-848eed83661c] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:56.141547 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e64d22e7-23ba-40d2-9874-fe7e95221134 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:56.142736 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e64d22e7-23ba-40d2-9874-fe7e95221134 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:56.155640 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e64d22e7-23ba-40d2-9874-fe7e95221134 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:56.157060 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e64d22e7-23ba-40d2-9874-fe7e95221134 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:56.381891 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-e64d22e7-23ba-40d2-9874-fe7e95221134 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683ec43ae844757883a7dd5003b53d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a75cf80284f58b9c3bed674677a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:56.390651 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-e64d22e7-23ba-40d2-9874-fe7e95221134 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "GET /compute/v2.1/servers/e8ab62c1-6839-4a58-9dd4-848eed83661c" status: 200 len: 1264 microversion: 2.1 time: 0.284761 May 26 18:08:56.391505 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 499/971] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:08:56 2022] GET /compute/v2.1/servers/e8ab62c1-6839-4a58-9dd4-848eed83661c => generated 1264 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:56.400776 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-6a97eb9e-59f7-43e7-8b04-ee8cc8c7ec42 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:56.402139 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-6a97eb9e-59f7-43e7-8b04-ee8cc8c7ec42 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] [instance: 27142015-9fcb-4e3e-802d-f687fda3c961] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:56.408981 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6a97eb9e-59f7-43e7-8b04-ee8cc8c7ec42 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:56.409438 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6a97eb9e-59f7-43e7-8b04-ee8cc8c7ec42 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:56.411218 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6a97eb9e-59f7-43e7-8b04-ee8cc8c7ec42 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:56.411964 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6a97eb9e-59f7-43e7-8b04-ee8cc8c7ec42 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:56.567088 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-6a97eb9e-59f7-43e7-8b04-ee8cc8c7ec42 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab7e96c0db34764bc2ac1e20d0ac35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6805a7efbeb448d8bc42a86ff756071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:56.575398 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-6a97eb9e-59f7-43e7-8b04-ee8cc8c7ec42 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] 10.222.0.69 "GET /compute/v2.1/servers/27142015-9fcb-4e3e-802d-f687fda3c961" status: 200 len: 1313 microversion: 2.1 time: 0.178498 May 26 18:08:56.576308 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 473/972] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:08:56 2022] GET /compute/v2.1/servers/27142015-9fcb-4e3e-802d-f687fda3c961 => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:57.410498 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-634b5348-ef6f-4a4f-bdce-c7b1aa965228 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:57.410950 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-634b5348-ef6f-4a4f-bdce-c7b1aa965228 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: e8ab62c1-6839-4a58-9dd4-848eed83661c] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:57.417816 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-634b5348-ef6f-4a4f-bdce-c7b1aa965228 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:57.418266 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-634b5348-ef6f-4a4f-bdce-c7b1aa965228 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:57.419043 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-634b5348-ef6f-4a4f-bdce-c7b1aa965228 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:57.419480 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-634b5348-ef6f-4a4f-bdce-c7b1aa965228 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:57.601120 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-12717dfc-44b5-42d8-bf4c-6528226fe8f6 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:57.602466 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-12717dfc-44b5-42d8-bf4c-6528226fe8f6 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] [instance: 27142015-9fcb-4e3e-802d-f687fda3c961] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:57.606384 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:57.610664 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-12717dfc-44b5-42d8-bf4c-6528226fe8f6 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:57.611138 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-12717dfc-44b5-42d8-bf4c-6528226fe8f6 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:57.611998 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-12717dfc-44b5-42d8-bf4c-6528226fe8f6 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:57.613200 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-12717dfc-44b5-42d8-bf4c-6528226fe8f6 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:57.620601 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-634b5348-ef6f-4a4f-bdce-c7b1aa965228 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683ec43ae844757883a7dd5003b53d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a75cf80284f58b9c3bed674677a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:57.629019 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-634b5348-ef6f-4a4f-bdce-c7b1aa965228 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "GET /compute/v2.1/servers/e8ab62c1-6839-4a58-9dd4-848eed83661c" status: 200 len: 1264 microversion: 2.1 time: 0.223008 May 26 18:08:57.629877 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 500/973] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:08:57 2022] GET /compute/v2.1/servers/e8ab62c1-6839-4a58-9dd4-848eed83661c => generated 1264 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:57.766564 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-12717dfc-44b5-42d8-bf4c-6528226fe8f6 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab7e96c0db34764bc2ac1e20d0ac35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6805a7efbeb448d8bc42a86ff756071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:57.774585 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-12717dfc-44b5-42d8-bf4c-6528226fe8f6 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] 10.222.0.69 "GET /compute/v2.1/servers/27142015-9fcb-4e3e-802d-f687fda3c961" status: 200 len: 1313 microversion: 2.1 time: 0.178282 May 26 18:08:57.784609 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 474/974] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:08:57 2022] GET /compute/v2.1/servers/27142015-9fcb-4e3e-802d-f687fda3c961 => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:08:58.043327 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-d94fa084-ab92-456c-bc25-6ed047107fb5 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:58.044314 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-d94fa084-ab92-456c-bc25-6ed047107fb5 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:58.051434 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d94fa084-ab92-456c-bc25-6ed047107fb5 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:58.051877 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d94fa084-ab92-456c-bc25-6ed047107fb5 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:58.052723 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d94fa084-ab92-456c-bc25-6ed047107fb5 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:58.053354 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d94fa084-ab92-456c-bc25-6ed047107fb5 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:58.088577 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-d94fa084-ab92-456c-bc25-6ed047107fb5 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049545 May 26 18:08:58.089170 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 501/975] 10.222.0.69 () {60 vars in 1342 bytes} [Thu May 26 18:08:58 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:58.166064 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-ae9aabdf-817d-42af-983b-786e1b17f30b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:58.166566 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-ae9aabdf-817d-42af-983b-786e1b17f30b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:58.172765 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ae9aabdf-817d-42af-983b-786e1b17f30b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:58.173217 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ae9aabdf-817d-42af-983b-786e1b17f30b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:58.173990 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ae9aabdf-817d-42af-983b-786e1b17f30b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:58.174448 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ae9aabdf-817d-42af-983b-786e1b17f30b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:58.203905 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-ae9aabdf-817d-42af-983b-786e1b17f30b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Going to try to terminate instance {{(pid=117723) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:08:58.297444 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-ae9aabdf-817d-42af-983b-786e1b17f30b tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "DELETE /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 204 len: 0 microversion: 2.20 time: 0.135190 May 26 18:08:58.298636 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 475/976] 10.222.0.69 () {60 vars in 1279 bytes} [Thu May 26 18:08:58 2022] DELETE /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 18:08:58.309240 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-b0963060-ddd1-4781-9a14-f7f4ca52d485 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:58.309867 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-b0963060-ddd1-4781-9a14-f7f4ca52d485 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:58.327391 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b0963060-ddd1-4781-9a14-f7f4ca52d485 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:58.329538 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-9e10568e-382d-4d94-9060-8e9f6f64f2d1 req-976362d9-b46e-4591-9e92-52bffd5fa43a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8ab62c1-6839-4a58-9dd4-848eed83661c", "name": "network-vif-plugged", "status": "completed", "tag": "c33d9d21-0d51-4503-906b-480b6fb62472"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:08:58.330255 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b0963060-ddd1-4781-9a14-f7f4ca52d485 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:58.331218 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b0963060-ddd1-4781-9a14-f7f4ca52d485 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:58.331682 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b0963060-ddd1-4781-9a14-f7f4ca52d485 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:58.350800 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-9e10568e-382d-4d94-9060-8e9f6f64f2d1 req-976362d9-b46e-4591-9e92-52bffd5fa43a service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:58.351539 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-9e10568e-382d-4d94-9060-8e9f6f64f2d1 req-976362d9-b46e-4591-9e92-52bffd5fa43a service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:58.371863 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-9e10568e-382d-4d94-9060-8e9f6f64f2d1 req-976362d9-b46e-4591-9e92-52bffd5fa43a service nova] Creating event network-vif-plugged:c33d9d21-0d51-4503-906b-480b6fb62472 for instance e8ab62c1-6839-4a58-9dd4-848eed83661c on hv-cinder-83607 May 26 18:08:58.385187 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-9e10568e-382d-4d94-9060-8e9f6f64f2d1 req-976362d9-b46e-4591-9e92-52bffd5fa43a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068184 May 26 18:08:58.385822 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 476/977] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:08:58.499561 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-b0963060-ddd1-4781-9a14-f7f4ca52d485 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:58.510754 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-b0963060-ddd1-4781-9a14-f7f4ca52d485 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:58.513077 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-b0963060-ddd1-4781-9a14-f7f4ca52d485 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:58.515370 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-b0963060-ddd1-4781-9a14-f7f4ca52d485 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1721 microversion: 2.20 time: 0.210765 May 26 18:08:58.515718 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 502/978] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:08:58 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1721 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:08:58.647861 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-e4150214-e485-4ccd-97c7-c84c02a213ec tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:58.648671 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-e4150214-e485-4ccd-97c7-c84c02a213ec tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: e8ab62c1-6839-4a58-9dd4-848eed83661c] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:58.655821 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e4150214-e485-4ccd-97c7-c84c02a213ec tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:58.656530 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e4150214-e485-4ccd-97c7-c84c02a213ec tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:58.657382 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e4150214-e485-4ccd-97c7-c84c02a213ec tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:58.657827 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e4150214-e485-4ccd-97c7-c84c02a213ec tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:58.793764 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-3fd706d7-6800-45f9-92f8-b53466b352b2 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:58.794643 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-3fd706d7-6800-45f9-92f8-b53466b352b2 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] [instance: 27142015-9fcb-4e3e-802d-f687fda3c961] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:58.803813 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3fd706d7-6800-45f9-92f8-b53466b352b2 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:58.805974 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3fd706d7-6800-45f9-92f8-b53466b352b2 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:58.807350 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3fd706d7-6800-45f9-92f8-b53466b352b2 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:58.808391 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3fd706d7-6800-45f9-92f8-b53466b352b2 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:58.813300 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-e4150214-e485-4ccd-97c7-c84c02a213ec tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683ec43ae844757883a7dd5003b53d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a75cf80284f58b9c3bed674677a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:58.823400 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-e4150214-e485-4ccd-97c7-c84c02a213ec tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "GET /compute/v2.1/servers/e8ab62c1-6839-4a58-9dd4-848eed83661c" status: 200 len: 1264 microversion: 2.1 time: 0.180122 May 26 18:08:58.833475 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 477/979] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:08:58 2022] GET /compute/v2.1/servers/e8ab62c1-6839-4a58-9dd4-848eed83661c => generated 1264 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:59.006763 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-3fd706d7-6800-45f9-92f8-b53466b352b2 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab7e96c0db34764bc2ac1e20d0ac35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6805a7efbeb448d8bc42a86ff756071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:59.014380 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-3fd706d7-6800-45f9-92f8-b53466b352b2 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] 10.222.0.69 "GET /compute/v2.1/servers/27142015-9fcb-4e3e-802d-f687fda3c961" status: 200 len: 1313 microversion: 2.1 time: 0.227387 May 26 18:08:59.014963 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 503/980] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:08:58 2022] GET /compute/v2.1/servers/27142015-9fcb-4e3e-802d-f687fda3c961 => generated 1313 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:59.535574 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-d84d3578-048f-43c4-89ef-c12947b97762 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:59.536216 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-d84d3578-048f-43c4-89ef-c12947b97762 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:59.542615 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d84d3578-048f-43c4-89ef-c12947b97762 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:59.543087 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d84d3578-048f-43c4-89ef-c12947b97762 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:59.544123 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d84d3578-048f-43c4-89ef-c12947b97762 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:59.544563 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d84d3578-048f-43c4-89ef-c12947b97762 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:59.783295 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-d84d3578-048f-43c4-89ef-c12947b97762 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:59.793973 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-d84d3578-048f-43c4-89ef-c12947b97762 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:59.795925 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-d84d3578-048f-43c4-89ef-c12947b97762 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:59.796984 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-d84d3578-048f-43c4-89ef-c12947b97762 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1721 microversion: 2.20 time: 0.265855 May 26 18:08:59.797564 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 478/981] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:08:59 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1721 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:08:59.842652 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-fba06c84-a041-4193-8ee3-2fbd7dbae647 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:59.843940 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-fba06c84-a041-4193-8ee3-2fbd7dbae647 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: e8ab62c1-6839-4a58-9dd4-848eed83661c] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:59.851796 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-fba06c84-a041-4193-8ee3-2fbd7dbae647 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:59.852551 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-fba06c84-a041-4193-8ee3-2fbd7dbae647 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:59.853519 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-fba06c84-a041-4193-8ee3-2fbd7dbae647 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:59.854117 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-fba06c84-a041-4193-8ee3-2fbd7dbae647 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:00.032268 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-d3622960-9729-4692-bfd7-340633213a3e tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:00.033203 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-d3622960-9729-4692-bfd7-340633213a3e tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] [instance: 27142015-9fcb-4e3e-802d-f687fda3c961] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:00.055407 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d3622960-9729-4692-bfd7-340633213a3e tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:00.056142 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d3622960-9729-4692-bfd7-340633213a3e tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:00.057150 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d3622960-9729-4692-bfd7-340633213a3e tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:00.057809 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d3622960-9729-4692-bfd7-340633213a3e tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:00.128275 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-fba06c84-a041-4193-8ee3-2fbd7dbae647 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683ec43ae844757883a7dd5003b53d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a75cf80284f58b9c3bed674677a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:00.147332 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-fba06c84-a041-4193-8ee3-2fbd7dbae647 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "GET /compute/v2.1/servers/e8ab62c1-6839-4a58-9dd4-848eed83661c" status: 200 len: 1264 microversion: 2.1 time: 0.300422 May 26 18:09:00.163237 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 504/982] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:08:59 2022] GET /compute/v2.1/servers/e8ab62c1-6839-4a58-9dd4-848eed83661c => generated 1264 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:00.245284 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell0:SELECT=4 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:00.269777 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell0:SELECT=12 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:00.328531 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-d3622960-9729-4692-bfd7-340633213a3e tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab7e96c0db34764bc2ac1e20d0ac35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6805a7efbeb448d8bc42a86ff756071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:00.337565 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-d3622960-9729-4692-bfd7-340633213a3e tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] 10.222.0.69 "GET /compute/v2.1/servers/27142015-9fcb-4e3e-802d-f687fda3c961" status: 200 len: 1313 microversion: 2.1 time: 0.309102 May 26 18:09:00.338436 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 479/983] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:09:00 2022] GET /compute/v2.1/servers/27142015-9fcb-4e3e-802d-f687fda3c961 => generated 1313 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:00.417122 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [req-84c9e9cd-c04b-43ea-997e-8346642587e7 req-efe8979e-3a54-4525-9c20-7d36e308e88b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27142015-9fcb-4e3e-802d-f687fda3c961", "name": "network-vif-plugged", "status": "completed", "tag": "4bfc50c2-aad1-4b81-895e-7c92538a1416"}]} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:09:00.430796 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-84c9e9cd-c04b-43ea-997e-8346642587e7 req-efe8979e-3a54-4525-9c20-7d36e308e88b service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:00.431252 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-84c9e9cd-c04b-43ea-997e-8346642587e7 req-efe8979e-3a54-4525-9c20-7d36e308e88b service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:00.446988 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_cell0:SELECT=4 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:00.450006 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.compute.server_external_events [req-84c9e9cd-c04b-43ea-997e-8346642587e7 req-efe8979e-3a54-4525-9c20-7d36e308e88b service nova] Creating event network-vif-plugged:4bfc50c2-aad1-4b81-895e-7c92538a1416 for instance 27142015-9fcb-4e3e-802d-f687fda3c961 on hv-cinder-83607 May 26 18:09:00.456262 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [req-84c9e9cd-c04b-43ea-997e-8346642587e7 req-efe8979e-3a54-4525-9c20-7d36e308e88b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045370 May 26 18:09:00.457304 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 505/984] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:09:00.816224 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-d5824b9b-8a34-4c2f-8c2e-d2dee9f5ac4f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:00.816845 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-d5824b9b-8a34-4c2f-8c2e-d2dee9f5ac4f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:00.824710 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d5824b9b-8a34-4c2f-8c2e-d2dee9f5ac4f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:00.825090 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d5824b9b-8a34-4c2f-8c2e-d2dee9f5ac4f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:00.825882 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d5824b9b-8a34-4c2f-8c2e-d2dee9f5ac4f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:00.826331 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d5824b9b-8a34-4c2f-8c2e-d2dee9f5ac4f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:00.921276 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-d5824b9b-8a34-4c2f-8c2e-d2dee9f5ac4f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:00.934176 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-d5824b9b-8a34-4c2f-8c2e-d2dee9f5ac4f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:00.935808 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-d5824b9b-8a34-4c2f-8c2e-d2dee9f5ac4f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7cc6fcd7b4c4cee8d21e2692757aaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab53cc69f7b0424cb689317c4be9b685', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:00.938470 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-d5824b9b-8a34-4c2f-8c2e-d2dee9f5ac4f tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 200 len: 1656 microversion: 2.20 time: 0.126104 May 26 18:09:00.940233 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 480/985] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:09:00 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 1656 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:09:00.945766 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [req-a16216b8-7a8b-4bc2-b6d7-39d6dc7a03d6 req-50cef432-17f8-4af1-9494-a7941ad08ce2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09d62436-ae28-4b39-90d2-4530f04e4f66", "name": "network-vif-deleted", "tag": "4f4d056e-de52-4943-ab5b-725a0214cc05"}]} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:09:00.973982 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-a16216b8-7a8b-4bc2-b6d7-39d6dc7a03d6 req-50cef432-17f8-4af1-9494-a7941ad08ce2 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:00.974856 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-a16216b8-7a8b-4bc2-b6d7-39d6dc7a03d6 req-50cef432-17f8-4af1-9494-a7941ad08ce2 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:01.001599 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.compute.server_external_events [req-a16216b8-7a8b-4bc2-b6d7-39d6dc7a03d6 req-50cef432-17f8-4af1-9494-a7941ad08ce2 service nova] Creating event network-vif-deleted:4f4d056e-de52-4943-ab5b-725a0214cc05 for instance 09d62436-ae28-4b39-90d2-4530f04e4f66 on hv-cinder-83607 May 26 18:09:01.007515 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [req-a16216b8-7a8b-4bc2-b6d7-39d6dc7a03d6 req-50cef432-17f8-4af1-9494-a7941ad08ce2 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067241 May 26 18:09:01.008478 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 506/986] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:09:01.166583 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-509bc560-bd34-4e96-8d70-65694ee06b0d tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:01.169788 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-509bc560-bd34-4e96-8d70-65694ee06b0d tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: e8ab62c1-6839-4a58-9dd4-848eed83661c] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:01.193162 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-509bc560-bd34-4e96-8d70-65694ee06b0d tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:01.193627 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-509bc560-bd34-4e96-8d70-65694ee06b0d tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:01.196138 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-509bc560-bd34-4e96-8d70-65694ee06b0d tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:01.196768 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-509bc560-bd34-4e96-8d70-65694ee06b0d tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:01.358982 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-6695c028-3671-4abd-88a8-d884321707e5 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:01.360532 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-6695c028-3671-4abd-88a8-d884321707e5 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] [instance: 27142015-9fcb-4e3e-802d-f687fda3c961] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:01.372282 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-6695c028-3671-4abd-88a8-d884321707e5 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:01.373695 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-6695c028-3671-4abd-88a8-d884321707e5 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:01.375963 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-6695c028-3671-4abd-88a8-d884321707e5 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:01.376945 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-6695c028-3671-4abd-88a8-d884321707e5 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:01.442374 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-509bc560-bd34-4e96-8d70-65694ee06b0d tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683ec43ae844757883a7dd5003b53d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a75cf80284f58b9c3bed674677a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:01.459418 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-509bc560-bd34-4e96-8d70-65694ee06b0d tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "GET /compute/v2.1/servers/e8ab62c1-6839-4a58-9dd4-848eed83661c" status: 200 len: 1451 microversion: 2.1 time: 0.296816 May 26 18:09:01.460857 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 481/987] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:09:01 2022] GET /compute/v2.1/servers/e8ab62c1-6839-4a58-9dd4-848eed83661c => generated 1451 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:01.481413 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-4a7af636-7753-495a-b975-d54f5000d41a tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:01.482501 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-4a7af636-7753-495a-b975-d54f5000d41a tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: e8ab62c1-6839-4a58-9dd4-848eed83661c] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:01.494161 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4a7af636-7753-495a-b975-d54f5000d41a tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:01.495907 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4a7af636-7753-495a-b975-d54f5000d41a tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:01.496951 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4a7af636-7753-495a-b975-d54f5000d41a tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:01.497621 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4a7af636-7753-495a-b975-d54f5000d41a tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:01.595505 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-6695c028-3671-4abd-88a8-d884321707e5 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab7e96c0db34764bc2ac1e20d0ac35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6805a7efbeb448d8bc42a86ff756071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:01.609403 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-6695c028-3671-4abd-88a8-d884321707e5 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] 10.222.0.69 "GET /compute/v2.1/servers/27142015-9fcb-4e3e-802d-f687fda3c961" status: 200 len: 1313 microversion: 2.1 time: 0.256779 May 26 18:09:01.610100 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 507/988] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:09:01 2022] GET /compute/v2.1/servers/27142015-9fcb-4e3e-802d-f687fda3c961 => generated 1313 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:01.706466 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-4a7af636-7753-495a-b975-d54f5000d41a tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683ec43ae844757883a7dd5003b53d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a75cf80284f58b9c3bed674677a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:01.715086 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-4a7af636-7753-495a-b975-d54f5000d41a tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "GET /compute/v2.1/servers/e8ab62c1-6839-4a58-9dd4-848eed83661c" status: 200 len: 1451 microversion: 2.1 time: 0.242715 May 26 18:09:01.715914 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 482/989] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:09:01 2022] GET /compute/v2.1/servers/e8ab62c1-6839-4a58-9dd4-848eed83661c => generated 1451 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:01.961668 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-10b9cd31-0c42-4266-87b8-fde188ddedb4 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:01.962668 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-10b9cd31-0c42-4266-87b8-fde188ddedb4 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:01.970025 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-10b9cd31-0c42-4266-87b8-fde188ddedb4 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:01.970700 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-10b9cd31-0c42-4266-87b8-fde188ddedb4 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:01.973713 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-10b9cd31-0c42-4266-87b8-fde188ddedb4 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:01.974830 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-10b9cd31-0c42-4266-87b8-fde188ddedb4 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:02.011982 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.wsgi [None req-10b9cd31-0c42-4266-87b8-fde188ddedb4 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] HTTP exception thrown: Instance 09d62436-ae28-4b39-90d2-4530f04e4f66 could not be found. May 26 18:09:02.015802 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-10b9cd31-0c42-4266-87b8-fde188ddedb4 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Request method failure captured: May 26 18:09:02.015802 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: request: GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 HTTP/1.1 May 26 18:09:02.015802 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Accept: application/json May 26 18:09:02.015802 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Accept-Encoding: identity May 26 18:09:02.015802 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Connection: close May 26 18:09:02.015802 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Content-Length: 0 May 26 18:09:02.015802 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Content-Type: application/json May 26 18:09:02.015802 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Host: 10.222.0.69 May 26 18:09:02.015802 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Openstack-System-Scope: None May 26 18:09:02.015802 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: User-Agent: python-urllib3/1.26.9 May 26 18:09:02.015802 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Auth-Token: gAAAAABij8BxpRwTq7ns-P1wYkedfpUueW3mAZi146E49MBrQ_ICTX574bgnFIcC8JTKOw16HbsXCxOVP8oC3ujHZDcUtuY8bGCGXJLA59VsbX0GKxw_BxOB2yV02HgVRzSAEwJUf8s8wVVFhuzNpi-dqbuUucVqkN7s1q3u97eu3bftR_HKDsA May 26 18:09:02.015802 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Domain-Id: None May 26 18:09:02.015802 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Domain-Name: None May 26 18:09:02.015802 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Identity-Status: Confirmed May 26 18:09:02.015802 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Is-Admin-Project: True May 26 18:09:02.015802 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Openstack-Nova-Api-Version: 2.20 May 26 18:09:02.015802 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Domain-Id: default May 26 18:09:02.015802 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Domain-Name: Default May 26 18:09:02.015802 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Id: ab53cc69f7b0424cb689317c4be9b685 May 26 18:09:02.015802 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1834557193 May 26 18:09:02.015802 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Role: member,reader May 26 18:09:02.015802 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Roles: member,reader May 26 18:09:02.017671 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ab53cc69f7b0424cb689317c4be9b685"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ab53cc69f7b0424cb689317c4be9b685"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ab53cc69f7b0424cb689317c4be9b685"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ab53cc69f7b0424cb689317c4be9b685"}]}] May 26 18:09:02.017671 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1834557193 May 26 18:09:02.017671 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant-Id: ab53cc69f7b0424cb689317c4be9b685 May 26 18:09:02.017671 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1834557193 May 26 18:09:02.017671 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User: tempest-AttachVolumeShelveTestJSON-1834557193-project May 26 18:09:02.017671 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Domain-Id: default May 26 18:09:02.017671 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Domain-Name: Default May 26 18:09:02.017671 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Id: a7cc6fcd7b4c4cee8d21e2692757aaf6 May 26 18:09:02.017671 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1834557193-project May 26 18:09:02.017671 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: method: > May 26 18:09:02.017671 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: exception: Instance 09d62436-ae28-4b39-90d2-4530f04e4f66 could not be found. May 26 18:09:02.017671 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: action_args: {'id': '09d62436-ae28-4b39-90d2-4530f04e4f66'} May 26 18:09:02.018619 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:09:02.018619 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:09:02.018619 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:09:02.018619 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:09:02.018619 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:09:02.018619 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:09:02.018619 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:09:02.018619 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:09:02.018619 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:09:02.018619 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:09:02.018619 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09d62436-ae28-4b39-90d2-4530f04e4f66 could not be found. May 26 18:09:02.018619 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:09:02.018619 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:09:02.018619 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:09:02.018619 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:09:02.018619 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:09:02.018619 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:09:02.018619 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:09:02.018619 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:09:02.018619 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:09:02.021267 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:09:02.021267 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:09:02.021267 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:09:02.021267 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:09:02.021267 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:09:02.021267 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:09:02.021267 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:09:02.021267 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09d62436-ae28-4b39-90d2-4530f04e4f66 could not be found. May 26 18:09:02.021267 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:09:02.021267 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:09:02.021267 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:09:02.021267 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:09:02.021267 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:09:02.021267 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:09:02.021267 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:09:02.021267 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:09:02.021267 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09d62436-ae28-4b39-90d2-4530f04e4f66 could not be found. May 26 18:09:02.021267 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:09:02.022818 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-10b9cd31-0c42-4266-87b8-fde188ddedb4 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Returning 404 to user: Instance 09d62436-ae28-4b39-90d2-4530f04e4f66 could not be found. {{(pid=117722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:09:02.022818 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-10b9cd31-0c42-4266-87b8-fde188ddedb4 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 404 len: 111 microversion: 2.20 time: 0.064473 May 26 18:09:02.022818 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 508/990] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:09:01 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 18:09:02.036778 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-ba8fc1cd-6db9-41ac-af8e-d2500371198d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '.version_select at 0x7f3abde3f820>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:02.075996 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-ba8fc1cd-6db9-41ac-af8e-d2500371198d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1559838106" status: 204 len: 0 microversion: 2.20 time: 0.049071 May 26 18:09:02.076694 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 483/991] 10.222.0.69 () {60 vars in 1261 bytes} [Thu May 26 18:09:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1559838106 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 18:09:02.628827 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-41851e50-5f2f-4860-80d1-32040de3c00c tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:02.629920 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-41851e50-5f2f-4860-80d1-32040de3c00c tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] [instance: 27142015-9fcb-4e3e-802d-f687fda3c961] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:02.637355 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-41851e50-5f2f-4860-80d1-32040de3c00c tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:02.637812 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-41851e50-5f2f-4860-80d1-32040de3c00c tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:02.638592 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-41851e50-5f2f-4860-80d1-32040de3c00c tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:02.639032 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-41851e50-5f2f-4860-80d1-32040de3c00c tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:02.883056 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-41851e50-5f2f-4860-80d1-32040de3c00c tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab7e96c0db34764bc2ac1e20d0ac35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6805a7efbeb448d8bc42a86ff756071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:02.892750 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-41851e50-5f2f-4860-80d1-32040de3c00c tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] 10.222.0.69 "GET /compute/v2.1/servers/27142015-9fcb-4e3e-802d-f687fda3c961" status: 200 len: 1496 microversion: 2.1 time: 0.268469 May 26 18:09:02.902679 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 509/992] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:09:02 2022] GET /compute/v2.1/servers/27142015-9fcb-4e3e-802d-f687fda3c961 => generated 1496 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:03.433201 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-e635b646-9ec9-4525-9e88-553ff36f15f9 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:03.434051 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-e635b646-9ec9-4525-9e88-553ff36f15f9 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] [instance: 27142015-9fcb-4e3e-802d-f687fda3c961] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:03.443986 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e635b646-9ec9-4525-9e88-553ff36f15f9 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:03.444522 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e635b646-9ec9-4525-9e88-553ff36f15f9 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:03.445333 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e635b646-9ec9-4525-9e88-553ff36f15f9 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:03.445773 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e635b646-9ec9-4525-9e88-553ff36f15f9 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:03.450248 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:03.474279 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-e635b646-9ec9-4525-9e88-553ff36f15f9 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] [instance: 27142015-9fcb-4e3e-802d-f687fda3c961] Going to try to terminate instance {{(pid=117723) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:09:03.577936 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-e635b646-9ec9-4525-9e88-553ff36f15f9 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] 10.222.0.69 "DELETE /compute/v2.1/servers/27142015-9fcb-4e3e-802d-f687fda3c961" status: 204 len: 0 microversion: 2.1 time: 0.149440 May 26 18:09:03.578646 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 484/993] 10.222.0.69 () {58 vars in 1238 bytes} [Thu May 26 18:09:03 2022] DELETE /compute/v2.1/servers/27142015-9fcb-4e3e-802d-f687fda3c961 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 18:09:03.587801 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-a2dae02b-1940-4644-9b6f-bcab4a28a4a6 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:03.588477 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-a2dae02b-1940-4644-9b6f-bcab4a28a4a6 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] [instance: 27142015-9fcb-4e3e-802d-f687fda3c961] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:03.596217 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-a2dae02b-1940-4644-9b6f-bcab4a28a4a6 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:03.596995 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-a2dae02b-1940-4644-9b6f-bcab4a28a4a6 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:03.598537 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-a2dae02b-1940-4644-9b6f-bcab4a28a4a6 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:03.599224 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-a2dae02b-1940-4644-9b6f-bcab4a28a4a6 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:04.059894 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-a2dae02b-1940-4644-9b6f-bcab4a28a4a6 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab7e96c0db34764bc2ac1e20d0ac35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6805a7efbeb448d8bc42a86ff756071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:04.070646 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-a2dae02b-1940-4644-9b6f-bcab4a28a4a6 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] 10.222.0.69 "GET /compute/v2.1/servers/27142015-9fcb-4e3e-802d-f687fda3c961" status: 200 len: 1502 microversion: 2.1 time: 0.486433 May 26 18:09:04.071292 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 510/994] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:09:03 2022] GET /compute/v2.1/servers/27142015-9fcb-4e3e-802d-f687fda3c961 => generated 1502 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:04.195892 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-5c886b9e-e72e-4b3f-a6f0-4d1fa902d712 req-b648e751-a5c6-415f-879c-9eef32c3919d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8ab62c1-6839-4a58-9dd4-848eed83661c", "tag": "c33d9d21-0d51-4503-906b-480b6fb62472"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:09:04.206720 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-5c886b9e-e72e-4b3f-a6f0-4d1fa902d712 req-b648e751-a5c6-415f-879c-9eef32c3919d service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:04.207380 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-5c886b9e-e72e-4b3f-a6f0-4d1fa902d712 req-b648e751-a5c6-415f-879c-9eef32c3919d service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:04.220141 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-5c886b9e-e72e-4b3f-a6f0-4d1fa902d712 req-b648e751-a5c6-415f-879c-9eef32c3919d service nova] Creating event network-changed:c33d9d21-0d51-4503-906b-480b6fb62472 for instance e8ab62c1-6839-4a58-9dd4-848eed83661c on hv-cinder-83607 May 26 18:09:04.226575 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-5c886b9e-e72e-4b3f-a6f0-4d1fa902d712 req-b648e751-a5c6-415f-879c-9eef32c3919d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034864 May 26 18:09:04.227298 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 485/995] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:09:04.261487 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-20a8ab12-2601-4b33-ba96-59bc773594dd tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:04.261998 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-20a8ab12-2601-4b33-ba96-59bc773594dd tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:04.268693 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-20a8ab12-2601-4b33-ba96-59bc773594dd tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:04.269816 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-20a8ab12-2601-4b33-ba96-59bc773594dd tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:04.271522 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-20a8ab12-2601-4b33-ba96-59bc773594dd tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:04.272191 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-20a8ab12-2601-4b33-ba96-59bc773594dd tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:04.289808 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.wsgi [None req-20a8ab12-2601-4b33-ba96-59bc773594dd tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] HTTP exception thrown: Instance 09d62436-ae28-4b39-90d2-4530f04e4f66 could not be found. May 26 18:09:04.291827 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-20a8ab12-2601-4b33-ba96-59bc773594dd tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Request method failure captured: May 26 18:09:04.291827 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: request: DELETE /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 HTTP/1.1 May 26 18:09:04.291827 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Accept: application/json May 26 18:09:04.291827 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Accept-Encoding: identity May 26 18:09:04.291827 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Connection: close May 26 18:09:04.291827 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Content-Length: 0 May 26 18:09:04.291827 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Content-Type: application/json May 26 18:09:04.291827 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Host: 10.222.0.69 May 26 18:09:04.291827 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Openstack-System-Scope: None May 26 18:09:04.291827 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: User-Agent: python-urllib3/1.26.9 May 26 18:09:04.291827 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Auth-Token: gAAAAABij8BxpRwTq7ns-P1wYkedfpUueW3mAZi146E49MBrQ_ICTX574bgnFIcC8JTKOw16HbsXCxOVP8oC3ujHZDcUtuY8bGCGXJLA59VsbX0GKxw_BxOB2yV02HgVRzSAEwJUf8s8wVVFhuzNpi-dqbuUucVqkN7s1q3u97eu3bftR_HKDsA May 26 18:09:04.291827 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Domain-Id: None May 26 18:09:04.291827 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Domain-Name: None May 26 18:09:04.291827 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Identity-Status: Confirmed May 26 18:09:04.291827 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Is-Admin-Project: True May 26 18:09:04.291827 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Openstack-Nova-Api-Version: 2.20 May 26 18:09:04.291827 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Domain-Id: default May 26 18:09:04.291827 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Domain-Name: Default May 26 18:09:04.291827 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Id: ab53cc69f7b0424cb689317c4be9b685 May 26 18:09:04.291827 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1834557193 May 26 18:09:04.291827 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Role: member,reader May 26 18:09:04.291827 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Roles: member,reader May 26 18:09:04.293542 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ab53cc69f7b0424cb689317c4be9b685"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ab53cc69f7b0424cb689317c4be9b685"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ab53cc69f7b0424cb689317c4be9b685"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ab53cc69f7b0424cb689317c4be9b685"}]}] May 26 18:09:04.293542 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1834557193 May 26 18:09:04.293542 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant-Id: ab53cc69f7b0424cb689317c4be9b685 May 26 18:09:04.293542 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1834557193 May 26 18:09:04.293542 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User: tempest-AttachVolumeShelveTestJSON-1834557193-project May 26 18:09:04.293542 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Domain-Id: default May 26 18:09:04.293542 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Domain-Name: Default May 26 18:09:04.293542 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Id: a7cc6fcd7b4c4cee8d21e2692757aaf6 May 26 18:09:04.293542 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1834557193-project May 26 18:09:04.293542 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: method: > May 26 18:09:04.293542 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: exception: Instance 09d62436-ae28-4b39-90d2-4530f04e4f66 could not be found. May 26 18:09:04.293542 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: action_args: {'id': '09d62436-ae28-4b39-90d2-4530f04e4f66'} May 26 18:09:04.294544 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:09:04.294544 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:09:04.294544 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:09:04.294544 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:09:04.294544 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:09:04.294544 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:09:04.294544 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:09:04.294544 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:09:04.294544 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:09:04.294544 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:09:04.294544 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09d62436-ae28-4b39-90d2-4530f04e4f66 could not be found. May 26 18:09:04.294544 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:09:04.294544 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:09:04.294544 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:09:04.294544 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:09:04.294544 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:09:04.294544 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:09:04.294544 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:09:04.294544 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:09:04.294544 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:09:04.296334 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:09:04.296334 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 18:09:04.296334 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 18:09:04.296334 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 18:09:04.296334 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 18:09:04.296334 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:09:04.296334 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:09:04.296334 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:09:04.296334 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:09:04.296334 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09d62436-ae28-4b39-90d2-4530f04e4f66 could not be found. May 26 18:09:04.296334 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:09:04.296334 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:09:04.296334 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:09:04.296334 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:09:04.296334 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:09:04.296334 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:09:04.296334 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:09:04.296334 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:09:04.296334 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09d62436-ae28-4b39-90d2-4530f04e4f66 could not be found. May 26 18:09:04.296334 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:09:04.299652 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-20a8ab12-2601-4b33-ba96-59bc773594dd tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Returning 404 to user: Instance 09d62436-ae28-4b39-90d2-4530f04e4f66 could not be found. {{(pid=117722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:09:04.301901 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-20a8ab12-2601-4b33-ba96-59bc773594dd tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "DELETE /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 404 len: 111 microversion: 2.20 time: 0.044015 May 26 18:09:04.302498 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 511/996] 10.222.0.69 () {60 vars in 1279 bytes} [Thu May 26 18:09:04 2022] DELETE /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 18:09:04.314828 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-3c9296ba-c6ef-4ea1-87cf-d0e8b20c3b3d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:04.315656 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-3c9296ba-c6ef-4ea1-87cf-d0e8b20c3b3d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 09d62436-ae28-4b39-90d2-4530f04e4f66] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:04.322346 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3c9296ba-c6ef-4ea1-87cf-d0e8b20c3b3d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:04.323027 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3c9296ba-c6ef-4ea1-87cf-d0e8b20c3b3d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:04.324229 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3c9296ba-c6ef-4ea1-87cf-d0e8b20c3b3d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:04.324781 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3c9296ba-c6ef-4ea1-87cf-d0e8b20c3b3d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:04.340897 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.wsgi [None req-3c9296ba-c6ef-4ea1-87cf-d0e8b20c3b3d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] HTTP exception thrown: Instance 09d62436-ae28-4b39-90d2-4530f04e4f66 could not be found. May 26 18:09:04.342973 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-3c9296ba-c6ef-4ea1-87cf-d0e8b20c3b3d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Request method failure captured: May 26 18:09:04.342973 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: request: GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 HTTP/1.1 May 26 18:09:04.342973 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Accept: application/json May 26 18:09:04.342973 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Accept-Encoding: identity May 26 18:09:04.342973 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Connection: close May 26 18:09:04.342973 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Content-Length: 0 May 26 18:09:04.342973 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Content-Type: application/json May 26 18:09:04.342973 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Host: 10.222.0.69 May 26 18:09:04.342973 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Openstack-System-Scope: None May 26 18:09:04.342973 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: User-Agent: python-urllib3/1.26.9 May 26 18:09:04.342973 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Auth-Token: gAAAAABij8BxpRwTq7ns-P1wYkedfpUueW3mAZi146E49MBrQ_ICTX574bgnFIcC8JTKOw16HbsXCxOVP8oC3ujHZDcUtuY8bGCGXJLA59VsbX0GKxw_BxOB2yV02HgVRzSAEwJUf8s8wVVFhuzNpi-dqbuUucVqkN7s1q3u97eu3bftR_HKDsA May 26 18:09:04.342973 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Domain-Id: None May 26 18:09:04.342973 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Domain-Name: None May 26 18:09:04.342973 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Identity-Status: Confirmed May 26 18:09:04.342973 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Is-Admin-Project: True May 26 18:09:04.342973 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Openstack-Nova-Api-Version: 2.20 May 26 18:09:04.342973 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Domain-Id: default May 26 18:09:04.342973 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Domain-Name: Default May 26 18:09:04.342973 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Id: ab53cc69f7b0424cb689317c4be9b685 May 26 18:09:04.342973 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1834557193 May 26 18:09:04.342973 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Role: member,reader May 26 18:09:04.342973 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Roles: member,reader May 26 18:09:04.344922 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ab53cc69f7b0424cb689317c4be9b685"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ab53cc69f7b0424cb689317c4be9b685"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ab53cc69f7b0424cb689317c4be9b685"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ab53cc69f7b0424cb689317c4be9b685"}]}] May 26 18:09:04.344922 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1834557193 May 26 18:09:04.344922 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant-Id: ab53cc69f7b0424cb689317c4be9b685 May 26 18:09:04.344922 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1834557193 May 26 18:09:04.344922 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User: tempest-AttachVolumeShelveTestJSON-1834557193-project May 26 18:09:04.344922 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Domain-Id: default May 26 18:09:04.344922 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Domain-Name: Default May 26 18:09:04.344922 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Id: a7cc6fcd7b4c4cee8d21e2692757aaf6 May 26 18:09:04.344922 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1834557193-project May 26 18:09:04.344922 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: method: > May 26 18:09:04.344922 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: exception: Instance 09d62436-ae28-4b39-90d2-4530f04e4f66 could not be found. May 26 18:09:04.344922 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: action_args: {'id': '09d62436-ae28-4b39-90d2-4530f04e4f66'} May 26 18:09:04.345986 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:09:04.345986 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:09:04.345986 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:09:04.345986 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:09:04.345986 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:09:04.345986 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:09:04.345986 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:09:04.345986 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:09:04.345986 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:09:04.345986 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:09:04.345986 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09d62436-ae28-4b39-90d2-4530f04e4f66 could not be found. May 26 18:09:04.345986 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:09:04.345986 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:09:04.345986 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:09:04.345986 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:09:04.345986 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:09:04.345986 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:09:04.345986 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:09:04.345986 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:09:04.345986 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:09:04.348263 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:09:04.348263 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:09:04.348263 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:09:04.348263 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:09:04.348263 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:09:04.348263 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:09:04.348263 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:09:04.348263 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09d62436-ae28-4b39-90d2-4530f04e4f66 could not be found. May 26 18:09:04.348263 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:09:04.348263 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:09:04.348263 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:09:04.348263 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:09:04.348263 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:09:04.348263 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:09:04.348263 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:09:04.348263 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:09:04.348263 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09d62436-ae28-4b39-90d2-4530f04e4f66 could not be found. May 26 18:09:04.348263 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:09:04.350016 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-3c9296ba-c6ef-4ea1-87cf-d0e8b20c3b3d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Returning 404 to user: Instance 09d62436-ae28-4b39-90d2-4530f04e4f66 could not be found. {{(pid=117723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:09:04.350016 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-3c9296ba-c6ef-4ea1-87cf-d0e8b20c3b3d tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66" status: 404 len: 111 microversion: 2.20 time: 0.040072 May 26 18:09:04.350511 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 486/997] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:09:04 2022] GET /compute/v2.1/servers/09d62436-ae28-4b39-90d2-4530f04e4f66 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 18:09:05.090802 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-cd4c05b7-3d86-4136-8553-92c7b1470b6b tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:05.091625 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-cd4c05b7-3d86-4136-8553-92c7b1470b6b tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] [instance: 27142015-9fcb-4e3e-802d-f687fda3c961] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:05.102725 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_api:SELECT=75 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:05.104303 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-cd4c05b7-3d86-4136-8553-92c7b1470b6b tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:05.104770 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-cd4c05b7-3d86-4136-8553-92c7b1470b6b tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:05.105573 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-cd4c05b7-3d86-4136-8553-92c7b1470b6b tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:05.106067 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-cd4c05b7-3d86-4136-8553-92c7b1470b6b tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:05.434455 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-cd4c05b7-3d86-4136-8553-92c7b1470b6b tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab7e96c0db34764bc2ac1e20d0ac35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6805a7efbeb448d8bc42a86ff756071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:05.443157 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-cd4c05b7-3d86-4136-8553-92c7b1470b6b tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] 10.222.0.69 "GET /compute/v2.1/servers/27142015-9fcb-4e3e-802d-f687fda3c961" status: 200 len: 1502 microversion: 2.1 time: 0.356994 May 26 18:09:05.443749 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 512/998] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:09:05 2022] GET /compute/v2.1/servers/27142015-9fcb-4e3e-802d-f687fda3c961 => generated 1502 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:05.514072 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-20337e5b-c493-451e-9da6-e6481c475752 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:05.514571 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-20337e5b-c493-451e-9da6-e6481c475752 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:05.521392 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-20337e5b-c493-451e-9da6-e6481c475752 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:05.521842 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-20337e5b-c493-451e-9da6-e6481c475752 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:05.522618 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-20337e5b-c493-451e-9da6-e6481c475752 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:05.523060 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-20337e5b-c493-451e-9da6-e6481c475752 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:05.538032 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.wsgi [None req-20337e5b-c493-451e-9da6-e6481c475752 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] HTTP exception thrown: Instance 262a4944-6c10-4122-adce-f7780ff4e7a1 could not be found. May 26 18:09:05.539597 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-20337e5b-c493-451e-9da6-e6481c475752 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Request method failure captured: May 26 18:09:05.539597 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: request: DELETE /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 HTTP/1.1 May 26 18:09:05.539597 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Accept: application/json May 26 18:09:05.539597 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Accept-Encoding: identity May 26 18:09:05.539597 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Connection: close May 26 18:09:05.539597 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Content-Length: 0 May 26 18:09:05.539597 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Content-Type: application/json May 26 18:09:05.539597 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Host: 10.222.0.69 May 26 18:09:05.539597 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Openstack-System-Scope: None May 26 18:09:05.539597 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: User-Agent: python-urllib3/1.26.9 May 26 18:09:05.539597 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Auth-Token: gAAAAABij8BxpRwTq7ns-P1wYkedfpUueW3mAZi146E49MBrQ_ICTX574bgnFIcC8JTKOw16HbsXCxOVP8oC3ujHZDcUtuY8bGCGXJLA59VsbX0GKxw_BxOB2yV02HgVRzSAEwJUf8s8wVVFhuzNpi-dqbuUucVqkN7s1q3u97eu3bftR_HKDsA May 26 18:09:05.539597 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Domain-Id: None May 26 18:09:05.539597 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Domain-Name: None May 26 18:09:05.539597 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Identity-Status: Confirmed May 26 18:09:05.539597 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Is-Admin-Project: True May 26 18:09:05.539597 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Openstack-Nova-Api-Version: 2.20 May 26 18:09:05.539597 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Domain-Id: default May 26 18:09:05.539597 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Domain-Name: Default May 26 18:09:05.539597 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Id: ab53cc69f7b0424cb689317c4be9b685 May 26 18:09:05.539597 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1834557193 May 26 18:09:05.539597 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Role: member,reader May 26 18:09:05.539597 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Roles: member,reader May 26 18:09:05.541304 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ab53cc69f7b0424cb689317c4be9b685"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ab53cc69f7b0424cb689317c4be9b685"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ab53cc69f7b0424cb689317c4be9b685"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ab53cc69f7b0424cb689317c4be9b685"}]}] May 26 18:09:05.541304 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1834557193 May 26 18:09:05.541304 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant-Id: ab53cc69f7b0424cb689317c4be9b685 May 26 18:09:05.541304 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1834557193 May 26 18:09:05.541304 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User: tempest-AttachVolumeShelveTestJSON-1834557193-project May 26 18:09:05.541304 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Domain-Id: default May 26 18:09:05.541304 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Domain-Name: Default May 26 18:09:05.541304 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Id: a7cc6fcd7b4c4cee8d21e2692757aaf6 May 26 18:09:05.541304 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1834557193-project May 26 18:09:05.541304 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: method: > May 26 18:09:05.541304 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: exception: Instance 262a4944-6c10-4122-adce-f7780ff4e7a1 could not be found. May 26 18:09:05.541304 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: action_args: {'id': '262a4944-6c10-4122-adce-f7780ff4e7a1'} May 26 18:09:05.542294 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:09:05.542294 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:09:05.542294 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:09:05.542294 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:09:05.542294 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:09:05.542294 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:09:05.542294 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:09:05.542294 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:09:05.542294 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:09:05.542294 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:09:05.542294 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 262a4944-6c10-4122-adce-f7780ff4e7a1 could not be found. May 26 18:09:05.542294 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:09:05.542294 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:09:05.542294 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:09:05.542294 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:09:05.542294 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:09:05.542294 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:09:05.542294 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:09:05.542294 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:09:05.542294 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:09:05.543653 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:09:05.543653 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 18:09:05.543653 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 18:09:05.543653 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 18:09:05.543653 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 18:09:05.543653 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:09:05.543653 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:09:05.543653 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:09:05.543653 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:09:05.543653 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 262a4944-6c10-4122-adce-f7780ff4e7a1 could not be found. May 26 18:09:05.543653 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:09:05.543653 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:09:05.543653 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:09:05.543653 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:09:05.543653 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:09:05.543653 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:09:05.543653 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:09:05.543653 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:09:05.543653 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 262a4944-6c10-4122-adce-f7780ff4e7a1 could not be found. May 26 18:09:05.543653 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:09:05.545838 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-20337e5b-c493-451e-9da6-e6481c475752 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Returning 404 to user: Instance 262a4944-6c10-4122-adce-f7780ff4e7a1 could not be found. {{(pid=117723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:09:05.545838 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-20337e5b-c493-451e-9da6-e6481c475752 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "DELETE /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 404 len: 111 microversion: 2.20 time: 0.030920 May 26 18:09:05.545838 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 487/999] 10.222.0.69 () {60 vars in 1279 bytes} [Thu May 26 18:09:05 2022] DELETE /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 18:09:05.552359 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-9ebd4e53-6831-4a49-a8b4-2729d10fba08 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:05.552983 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-9ebd4e53-6831-4a49-a8b4-2729d10fba08 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] [instance: 262a4944-6c10-4122-adce-f7780ff4e7a1] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:05.561733 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-9ebd4e53-6831-4a49-a8b4-2729d10fba08 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:05.562409 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-9ebd4e53-6831-4a49-a8b4-2729d10fba08 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:05.563671 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-9ebd4e53-6831-4a49-a8b4-2729d10fba08 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:05.564304 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-9ebd4e53-6831-4a49-a8b4-2729d10fba08 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:05.583580 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.wsgi [None req-9ebd4e53-6831-4a49-a8b4-2729d10fba08 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] HTTP exception thrown: Instance 262a4944-6c10-4122-adce-f7780ff4e7a1 could not be found. May 26 18:09:05.585234 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-9ebd4e53-6831-4a49-a8b4-2729d10fba08 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Request method failure captured: May 26 18:09:05.585234 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: request: GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 HTTP/1.1 May 26 18:09:05.585234 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Accept: application/json May 26 18:09:05.585234 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Accept-Encoding: identity May 26 18:09:05.585234 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Connection: close May 26 18:09:05.585234 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Content-Length: 0 May 26 18:09:05.585234 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Content-Type: application/json May 26 18:09:05.585234 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Host: 10.222.0.69 May 26 18:09:05.585234 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Openstack-System-Scope: None May 26 18:09:05.585234 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: User-Agent: python-urllib3/1.26.9 May 26 18:09:05.585234 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Auth-Token: gAAAAABij8BxpRwTq7ns-P1wYkedfpUueW3mAZi146E49MBrQ_ICTX574bgnFIcC8JTKOw16HbsXCxOVP8oC3ujHZDcUtuY8bGCGXJLA59VsbX0GKxw_BxOB2yV02HgVRzSAEwJUf8s8wVVFhuzNpi-dqbuUucVqkN7s1q3u97eu3bftR_HKDsA May 26 18:09:05.585234 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Domain-Id: None May 26 18:09:05.585234 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Domain-Name: None May 26 18:09:05.585234 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Identity-Status: Confirmed May 26 18:09:05.585234 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Is-Admin-Project: True May 26 18:09:05.585234 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Openstack-Nova-Api-Version: 2.20 May 26 18:09:05.585234 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Domain-Id: default May 26 18:09:05.585234 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Domain-Name: Default May 26 18:09:05.585234 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Id: ab53cc69f7b0424cb689317c4be9b685 May 26 18:09:05.585234 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1834557193 May 26 18:09:05.585234 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Role: member,reader May 26 18:09:05.585234 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Roles: member,reader May 26 18:09:05.587170 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ab53cc69f7b0424cb689317c4be9b685"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ab53cc69f7b0424cb689317c4be9b685"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ab53cc69f7b0424cb689317c4be9b685"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ab53cc69f7b0424cb689317c4be9b685"}]}] May 26 18:09:05.587170 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1834557193 May 26 18:09:05.587170 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant-Id: ab53cc69f7b0424cb689317c4be9b685 May 26 18:09:05.587170 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1834557193 May 26 18:09:05.587170 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User: tempest-AttachVolumeShelveTestJSON-1834557193-project May 26 18:09:05.587170 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Domain-Id: default May 26 18:09:05.587170 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Domain-Name: Default May 26 18:09:05.587170 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Id: a7cc6fcd7b4c4cee8d21e2692757aaf6 May 26 18:09:05.587170 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1834557193-project May 26 18:09:05.587170 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: method: > May 26 18:09:05.587170 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: exception: Instance 262a4944-6c10-4122-adce-f7780ff4e7a1 could not be found. May 26 18:09:05.587170 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: action_args: {'id': '262a4944-6c10-4122-adce-f7780ff4e7a1'} May 26 18:09:05.588137 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:09:05.588137 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:09:05.588137 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:09:05.588137 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:09:05.588137 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:09:05.588137 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:09:05.588137 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:09:05.588137 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:09:05.588137 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:09:05.588137 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:09:05.588137 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 262a4944-6c10-4122-adce-f7780ff4e7a1 could not be found. May 26 18:09:05.588137 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:09:05.588137 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:09:05.588137 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:09:05.588137 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:09:05.588137 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:09:05.588137 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:09:05.588137 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:09:05.588137 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:09:05.588137 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:09:05.589684 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:09:05.589684 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:09:05.589684 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:09:05.589684 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:09:05.589684 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:09:05.589684 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:09:05.589684 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:09:05.589684 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 262a4944-6c10-4122-adce-f7780ff4e7a1 could not be found. May 26 18:09:05.589684 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:09:05.589684 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:09:05.589684 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:09:05.589684 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:09:05.589684 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:09:05.589684 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:09:05.589684 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:09:05.589684 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:09:05.589684 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 262a4944-6c10-4122-adce-f7780ff4e7a1 could not be found. May 26 18:09:05.589684 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:09:05.591139 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-9ebd4e53-6831-4a49-a8b4-2729d10fba08 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] Returning 404 to user: Instance 262a4944-6c10-4122-adce-f7780ff4e7a1 could not be found. {{(pid=117722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:09:05.591139 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-9ebd4e53-6831-4a49-a8b4-2729d10fba08 tempest-AttachVolumeShelveTestJSON-1834557193 tempest-AttachVolumeShelveTestJSON-1834557193-project] 10.222.0.69 "GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1" status: 404 len: 111 microversion: 2.20 time: 0.039455 May 26 18:09:05.591139 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 513/1000] 10.222.0.69 () {60 vars in 1276 bytes} [Thu May 26 18:09:05 2022] GET /compute/v2.1/servers/262a4944-6c10-4122-adce-f7780ff4e7a1 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 18:09:06.247223 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-acad9282-4bf0-48eb-81dd-7d4bb1fa039c req-1bd16579-204d-4cb2-a1a8-bf1184f98a7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27142015-9fcb-4e3e-802d-f687fda3c961", "name": "network-vif-deleted", "tag": "4bfc50c2-aad1-4b81-895e-7c92538a1416"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:09:06.258805 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-acad9282-4bf0-48eb-81dd-7d4bb1fa039c req-1bd16579-204d-4cb2-a1a8-bf1184f98a7b service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:06.259782 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-acad9282-4bf0-48eb-81dd-7d4bb1fa039c req-1bd16579-204d-4cb2-a1a8-bf1184f98a7b service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:06.274116 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-acad9282-4bf0-48eb-81dd-7d4bb1fa039c req-1bd16579-204d-4cb2-a1a8-bf1184f98a7b service nova] Creating event network-vif-deleted:4bfc50c2-aad1-4b81-895e-7c92538a1416 for instance 27142015-9fcb-4e3e-802d-f687fda3c961 on hv-cinder-83607 May 26 18:09:06.279511 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-acad9282-4bf0-48eb-81dd-7d4bb1fa039c req-1bd16579-204d-4cb2-a1a8-bf1184f98a7b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038256 May 26 18:09:06.280231 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 488/1001] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:09:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:09:06.470549 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-eabce8b7-684a-4943-a753-539409965d90 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:06.471353 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-eabce8b7-684a-4943-a753-539409965d90 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] [instance: 27142015-9fcb-4e3e-802d-f687fda3c961] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:06.479383 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-eabce8b7-684a-4943-a753-539409965d90 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:06.480750 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-eabce8b7-684a-4943-a753-539409965d90 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:06.481740 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-eabce8b7-684a-4943-a753-539409965d90 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:06.482360 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-eabce8b7-684a-4943-a753-539409965d90 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:06.502541 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.wsgi [None req-eabce8b7-684a-4943-a753-539409965d90 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] HTTP exception thrown: Instance 27142015-9fcb-4e3e-802d-f687fda3c961 could not be found. May 26 18:09:06.508035 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-eabce8b7-684a-4943-a753-539409965d90 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Request method failure captured: May 26 18:09:06.508035 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: request: GET /compute/v2.1/servers/27142015-9fcb-4e3e-802d-f687fda3c961 HTTP/1.1 May 26 18:09:06.508035 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Accept: application/json May 26 18:09:06.508035 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Accept-Encoding: identity May 26 18:09:06.508035 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Connection: close May 26 18:09:06.508035 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Content-Length: 0 May 26 18:09:06.508035 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Content-Type: application/json May 26 18:09:06.508035 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Host: 10.222.0.69 May 26 18:09:06.508035 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Openstack-System-Scope: None May 26 18:09:06.508035 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: User-Agent: python-urllib3/1.26.9 May 26 18:09:06.508035 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Auth-Token: gAAAAABij8IvVEMljEaXjz0RAWQSsvvu0NXquqAWiqaqLUn3z2fX3THmI51LLtDwqh7GOPiZEQBiDM9jwFzHRN1D7hFtuTdIRHaLTsNbTXY6tCGqc8x_ToFaG3ANpZMpBH7fI_eqT43H9fUQNpQRlN6b2YXSyyFlbI8fy8R1PnINGMexwpPk2ug May 26 18:09:06.508035 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Domain-Id: None May 26 18:09:06.508035 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Domain-Name: None May 26 18:09:06.508035 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Identity-Status: Confirmed May 26 18:09:06.508035 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Is-Admin-Project: True May 26 18:09:06.508035 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Domain-Id: default May 26 18:09:06.508035 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Domain-Name: Default May 26 18:09:06.508035 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Id: f6805a7efbeb448d8bc42a86ff756071 May 26 18:09:06.508035 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Name: tempest-VolumesActionsTest-688175260 May 26 18:09:06.508035 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Role: member,reader May 26 18:09:06.508035 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Roles: member,reader May 26 18:09:06.509348 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f6805a7efbeb448d8bc42a86ff756071"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f6805a7efbeb448d8bc42a86ff756071"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f6805a7efbeb448d8bc42a86ff756071"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f6805a7efbeb448d8bc42a86ff756071"}]}] May 26 18:09:06.509348 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant: tempest-VolumesActionsTest-688175260 May 26 18:09:06.509348 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant-Id: f6805a7efbeb448d8bc42a86ff756071 May 26 18:09:06.509348 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant-Name: tempest-VolumesActionsTest-688175260 May 26 18:09:06.509348 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User: tempest-VolumesActionsTest-688175260-project May 26 18:09:06.509348 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Domain-Id: default May 26 18:09:06.509348 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Domain-Name: Default May 26 18:09:06.509348 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Id: 6ab7e96c0db34764bc2ac1e20d0ac35e May 26 18:09:06.509348 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Name: tempest-VolumesActionsTest-688175260-project May 26 18:09:06.509348 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: method: > May 26 18:09:06.509348 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: exception: Instance 27142015-9fcb-4e3e-802d-f687fda3c961 could not be found. May 26 18:09:06.509348 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: action_args: {'id': '27142015-9fcb-4e3e-802d-f687fda3c961'} May 26 18:09:06.510506 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:09:06.510506 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:09:06.510506 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:09:06.510506 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:09:06.510506 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:09:06.510506 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:09:06.510506 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:09:06.510506 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:09:06.510506 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:09:06.510506 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:09:06.510506 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27142015-9fcb-4e3e-802d-f687fda3c961 could not be found. May 26 18:09:06.510506 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:09:06.510506 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:09:06.510506 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:09:06.510506 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:09:06.510506 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:09:06.510506 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:09:06.510506 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:09:06.510506 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:09:06.510506 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:09:06.511903 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:09:06.511903 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:09:06.511903 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:09:06.511903 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:09:06.511903 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:09:06.511903 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:09:06.511903 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:09:06.511903 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27142015-9fcb-4e3e-802d-f687fda3c961 could not be found. May 26 18:09:06.511903 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:09:06.511903 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:09:06.511903 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:09:06.511903 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:09:06.511903 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:09:06.511903 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:09:06.511903 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:09:06.511903 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:09:06.511903 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27142015-9fcb-4e3e-802d-f687fda3c961 could not be found. May 26 18:09:06.511903 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:09:06.516329 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-eabce8b7-684a-4943-a753-539409965d90 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Returning 404 to user: Instance 27142015-9fcb-4e3e-802d-f687fda3c961 could not be found. {{(pid=117722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:09:06.516329 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-eabce8b7-684a-4943-a753-539409965d90 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] 10.222.0.69 "GET /compute/v2.1/servers/27142015-9fcb-4e3e-802d-f687fda3c961" status: 404 len: 111 microversion: 2.1 time: 0.045624 May 26 18:09:06.516329 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 514/1002] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:09:06 2022] GET /compute/v2.1/servers/27142015-9fcb-4e3e-802d-f687fda3c961 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:09:06.627997 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-af031345-ee15-4467-a93b-ac8a4d9efaf9 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-676011951", "imageRef": "16351c96-cb02-4711-99d5-fd4d80e8a846", "flavorRef": "452", "networks": [{"uuid": "69c7e340-930b-4e5f-9643-c62f279653d3"}]}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:09:06.682545 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.network.neutron [None req-af031345-ee15-4467-a93b-ac8a4d9efaf9 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] validate_networks() for [('69c7e340-930b-4e5f-9643-c62f279653d3', None, None, None, None, None)] {{(pid=117723) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:09:07.115923 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-af031345-ee15-4467-a93b-ac8a4d9efaf9 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Flavor limits 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:09:07.116501 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-af031345-ee15-4467-a93b-ac8a4d9efaf9 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Image limits 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:09:07.117252 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-af031345-ee15-4467-a93b-ac8a4d9efaf9 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Flavor pref 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:09:07.117754 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-af031345-ee15-4467-a93b-ac8a4d9efaf9 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Image pref 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:09:07.118538 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-af031345-ee15-4467-a93b-ac8a4d9efaf9 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:09:07.130841 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-af031345-ee15-4467-a93b-ac8a4d9efaf9 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:07.131381 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-af031345-ee15-4467-a93b-ac8a4d9efaf9 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:07.132284 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-af031345-ee15-4467-a93b-ac8a4d9efaf9 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:07.132789 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-af031345-ee15-4467-a93b-ac8a4d9efaf9 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:07.151040 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-af031345-ee15-4467-a93b-ac8a4d9efaf9 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Getting quotas for project f6805a7efbeb448d8bc42a86ff756071. Resources: {'instances', 'ram', 'cores'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:09:07.155201 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-af031345-ee15-4467-a93b-ac8a4d9efaf9 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Getting quotas for user 6ab7e96c0db34764bc2ac1e20d0ac35e and project f6805a7efbeb448d8bc42a86ff756071. Resources: {'instances', 'ram', 'cores'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:09:07.167725 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-af031345-ee15-4467-a93b-ac8a4d9efaf9 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Going to run 1 instances... {{(pid=117723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:09:07.170259 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-af031345-ee15-4467-a93b-ac8a4d9efaf9 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] [instance: 21aa42fa-cdba-45c2-a95d-f69ce2011540] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='16351c96-cb02-4711-99d5-fd4d80e8a846',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:09:07.221766 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-af031345-ee15-4467-a93b-ac8a4d9efaf9 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.598460 May 26 18:09:07.222600 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 489/1003] 10.222.0.69 () {60 vars in 1146 bytes} [Thu May 26 18:09:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 18:09:07.232813 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-0c209758-7e31-4a44-b865-466cab5da360 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:07.233685 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-0c209758-7e31-4a44-b865-466cab5da360 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] [instance: 21aa42fa-cdba-45c2-a95d-f69ce2011540] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:07.566018 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-0c209758-7e31-4a44-b865-466cab5da360 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab7e96c0db34764bc2ac1e20d0ac35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6805a7efbeb448d8bc42a86ff756071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:07.573851 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-0c209758-7e31-4a44-b865-466cab5da360 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] 10.222.0.69 "GET /compute/v2.1/servers/21aa42fa-cdba-45c2-a95d-f69ce2011540" status: 200 len: 1213 microversion: 2.1 time: 0.344874 May 26 18:09:07.574943 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 515/1004] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:09:07 2022] GET /compute/v2.1/servers/21aa42fa-cdba-45c2-a95d-f69ce2011540 => generated 1213 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:08.593625 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-8ffbc6e9-cd49-4d5f-a9ac-15dd5964a9cc tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:08.594311 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-8ffbc6e9-cd49-4d5f-a9ac-15dd5964a9cc tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] [instance: 21aa42fa-cdba-45c2-a95d-f69ce2011540] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:08.605021 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8ffbc6e9-cd49-4d5f-a9ac-15dd5964a9cc tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:08.605856 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8ffbc6e9-cd49-4d5f-a9ac-15dd5964a9cc tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:08.606650 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8ffbc6e9-cd49-4d5f-a9ac-15dd5964a9cc tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:08.607100 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8ffbc6e9-cd49-4d5f-a9ac-15dd5964a9cc tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:08.675115 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-8ffbc6e9-cd49-4d5f-a9ac-15dd5964a9cc tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab7e96c0db34764bc2ac1e20d0ac35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6805a7efbeb448d8bc42a86ff756071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:08.682913 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-8ffbc6e9-cd49-4d5f-a9ac-15dd5964a9cc tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] 10.222.0.69 "GET /compute/v2.1/servers/21aa42fa-cdba-45c2-a95d-f69ce2011540" status: 200 len: 1265 microversion: 2.1 time: 0.094440 May 26 18:09:08.683507 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 490/1005] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:09:08 2022] GET /compute/v2.1/servers/21aa42fa-cdba-45c2-a95d-f69ce2011540 => generated 1265 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:09.700931 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-089829ee-8843-4cba-804b-5dc44544e488 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:09.701630 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-089829ee-8843-4cba-804b-5dc44544e488 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] [instance: 21aa42fa-cdba-45c2-a95d-f69ce2011540] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:09.710053 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-089829ee-8843-4cba-804b-5dc44544e488 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:09.710513 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-089829ee-8843-4cba-804b-5dc44544e488 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:09.711302 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-089829ee-8843-4cba-804b-5dc44544e488 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:09.711741 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-089829ee-8843-4cba-804b-5dc44544e488 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:09.786952 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-089829ee-8843-4cba-804b-5dc44544e488 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab7e96c0db34764bc2ac1e20d0ac35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6805a7efbeb448d8bc42a86ff756071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:09.795903 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-089829ee-8843-4cba-804b-5dc44544e488 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] 10.222.0.69 "GET /compute/v2.1/servers/21aa42fa-cdba-45c2-a95d-f69ce2011540" status: 200 len: 1265 microversion: 2.1 time: 0.098874 May 26 18:09:09.796755 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 516/1006] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:09:09 2022] GET /compute/v2.1/servers/21aa42fa-cdba-45c2-a95d-f69ce2011540 => generated 1265 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:10.813945 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-fd606c7d-c378-4b69-adef-306360551b02 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:10.814719 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-fd606c7d-c378-4b69-adef-306360551b02 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] [instance: 21aa42fa-cdba-45c2-a95d-f69ce2011540] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:10.822542 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fd606c7d-c378-4b69-adef-306360551b02 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:10.822861 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fd606c7d-c378-4b69-adef-306360551b02 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:10.823571 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fd606c7d-c378-4b69-adef-306360551b02 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:10.824044 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fd606c7d-c378-4b69-adef-306360551b02 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:10.914230 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-fd606c7d-c378-4b69-adef-306360551b02 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab7e96c0db34764bc2ac1e20d0ac35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6805a7efbeb448d8bc42a86ff756071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:10.922225 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-fd606c7d-c378-4b69-adef-306360551b02 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] 10.222.0.69 "GET /compute/v2.1/servers/21aa42fa-cdba-45c2-a95d-f69ce2011540" status: 200 len: 1271 microversion: 2.1 time: 0.112694 May 26 18:09:10.924049 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 491/1007] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:09:10 2022] GET /compute/v2.1/servers/21aa42fa-cdba-45c2-a95d-f69ce2011540 => generated 1271 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:11.941132 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-180ae8b4-8632-4ef3-9abb-88955f775471 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:11.941754 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-180ae8b4-8632-4ef3-9abb-88955f775471 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] [instance: 21aa42fa-cdba-45c2-a95d-f69ce2011540] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:11.949431 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-180ae8b4-8632-4ef3-9abb-88955f775471 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:11.949956 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-180ae8b4-8632-4ef3-9abb-88955f775471 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:11.950979 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-180ae8b4-8632-4ef3-9abb-88955f775471 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:11.951424 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-180ae8b4-8632-4ef3-9abb-88955f775471 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:12.171084 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-180ae8b4-8632-4ef3-9abb-88955f775471 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab7e96c0db34764bc2ac1e20d0ac35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6805a7efbeb448d8bc42a86ff756071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:12.180471 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-180ae8b4-8632-4ef3-9abb-88955f775471 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] 10.222.0.69 "GET /compute/v2.1/servers/21aa42fa-cdba-45c2-a95d-f69ce2011540" status: 200 len: 1313 microversion: 2.1 time: 0.243479 May 26 18:09:12.181094 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 517/1008] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:09:11 2022] GET /compute/v2.1/servers/21aa42fa-cdba-45c2-a95d-f69ce2011540 => generated 1313 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:12.291074 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-56bc7877-2e31-465b-971d-a38a55cc0689 req-220f8825-7e18-49cf-911f-a2e2aade4935 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21aa42fa-cdba-45c2-a95d-f69ce2011540", "tag": "052ea3c5-0c1f-41b5-88c9-a61595742690"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:09:12.299978 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-56bc7877-2e31-465b-971d-a38a55cc0689 req-220f8825-7e18-49cf-911f-a2e2aade4935 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:12.300520 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-56bc7877-2e31-465b-971d-a38a55cc0689 req-220f8825-7e18-49cf-911f-a2e2aade4935 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:12.321550 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-56bc7877-2e31-465b-971d-a38a55cc0689 req-220f8825-7e18-49cf-911f-a2e2aade4935 service nova] Creating event network-changed:052ea3c5-0c1f-41b5-88c9-a61595742690 for instance 21aa42fa-cdba-45c2-a95d-f69ce2011540 on hv-cinder-83607 May 26 18:09:12.326957 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-56bc7877-2e31-465b-971d-a38a55cc0689 req-220f8825-7e18-49cf-911f-a2e2aade4935 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039808 May 26 18:09:12.327914 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 492/1009] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:09:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:09:13.199189 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-2e6b0a08-776d-43da-b397-8fe5d03352f6 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:13.199820 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-2e6b0a08-776d-43da-b397-8fe5d03352f6 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] [instance: 21aa42fa-cdba-45c2-a95d-f69ce2011540] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:13.206265 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-2e6b0a08-776d-43da-b397-8fe5d03352f6 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:13.206723 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-2e6b0a08-776d-43da-b397-8fe5d03352f6 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:13.208178 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-2e6b0a08-776d-43da-b397-8fe5d03352f6 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:13.208638 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-2e6b0a08-776d-43da-b397-8fe5d03352f6 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:13.213461 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_cell1:SELECT=100 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:13.352121 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-2e6b0a08-776d-43da-b397-8fe5d03352f6 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab7e96c0db34764bc2ac1e20d0ac35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6805a7efbeb448d8bc42a86ff756071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:13.359967 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-2e6b0a08-776d-43da-b397-8fe5d03352f6 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] 10.222.0.69 "GET /compute/v2.1/servers/21aa42fa-cdba-45c2-a95d-f69ce2011540" status: 200 len: 1313 microversion: 2.1 time: 0.165329 May 26 18:09:13.360717 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 518/1010] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:09:13 2022] GET /compute/v2.1/servers/21aa42fa-cdba-45c2-a95d-f69ce2011540 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:14.379475 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-b178ffe9-dc36-4d2e-86c2-07a9178eac4a tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:14.380394 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-b178ffe9-dc36-4d2e-86c2-07a9178eac4a tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] [instance: 21aa42fa-cdba-45c2-a95d-f69ce2011540] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:14.387787 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b178ffe9-dc36-4d2e-86c2-07a9178eac4a tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:14.388307 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b178ffe9-dc36-4d2e-86c2-07a9178eac4a tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:14.389096 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b178ffe9-dc36-4d2e-86c2-07a9178eac4a tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:14.389545 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b178ffe9-dc36-4d2e-86c2-07a9178eac4a tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:14.557133 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-b178ffe9-dc36-4d2e-86c2-07a9178eac4a tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab7e96c0db34764bc2ac1e20d0ac35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6805a7efbeb448d8bc42a86ff756071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:14.564935 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-b178ffe9-dc36-4d2e-86c2-07a9178eac4a tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] 10.222.0.69 "GET /compute/v2.1/servers/21aa42fa-cdba-45c2-a95d-f69ce2011540" status: 200 len: 1313 microversion: 2.1 time: 0.190762 May 26 18:09:14.565708 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 493/1011] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:09:14 2022] GET /compute/v2.1/servers/21aa42fa-cdba-45c2-a95d-f69ce2011540 => generated 1313 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:15.584955 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-9dec5f02-fe7c-4004-8b3c-d556a951e565 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:15.585791 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-9dec5f02-fe7c-4004-8b3c-d556a951e565 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] [instance: 21aa42fa-cdba-45c2-a95d-f69ce2011540] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:15.593889 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-9dec5f02-fe7c-4004-8b3c-d556a951e565 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:15.594342 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-9dec5f02-fe7c-4004-8b3c-d556a951e565 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:15.595338 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-9dec5f02-fe7c-4004-8b3c-d556a951e565 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:15.595770 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-9dec5f02-fe7c-4004-8b3c-d556a951e565 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:15.766011 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-9dec5f02-fe7c-4004-8b3c-d556a951e565 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab7e96c0db34764bc2ac1e20d0ac35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6805a7efbeb448d8bc42a86ff756071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:15.775893 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-9dec5f02-fe7c-4004-8b3c-d556a951e565 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] 10.222.0.69 "GET /compute/v2.1/servers/21aa42fa-cdba-45c2-a95d-f69ce2011540" status: 200 len: 1313 microversion: 2.1 time: 0.196464 May 26 18:09:15.786934 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 519/1012] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:09:15 2022] GET /compute/v2.1/servers/21aa42fa-cdba-45c2-a95d-f69ce2011540 => generated 1313 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:16.794319 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-982cfae1-434a-449a-a467-6b5c19034a6b tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:16.794937 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-982cfae1-434a-449a-a467-6b5c19034a6b tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] [instance: 21aa42fa-cdba-45c2-a95d-f69ce2011540] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:16.806051 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-982cfae1-434a-449a-a467-6b5c19034a6b tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:16.806516 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-982cfae1-434a-449a-a467-6b5c19034a6b tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:16.807325 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-982cfae1-434a-449a-a467-6b5c19034a6b tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:16.807773 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-982cfae1-434a-449a-a467-6b5c19034a6b tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:17.045797 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-982cfae1-434a-449a-a467-6b5c19034a6b tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab7e96c0db34764bc2ac1e20d0ac35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6805a7efbeb448d8bc42a86ff756071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:17.057014 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-982cfae1-434a-449a-a467-6b5c19034a6b tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] 10.222.0.69 "GET /compute/v2.1/servers/21aa42fa-cdba-45c2-a95d-f69ce2011540" status: 200 len: 1313 microversion: 2.1 time: 0.266439 May 26 18:09:17.058484 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 494/1013] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:09:16 2022] GET /compute/v2.1/servers/21aa42fa-cdba-45c2-a95d-f69ce2011540 => generated 1313 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:17.728438 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-119763f5-063e-4741-a49a-dca55d58bc40 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:17.728933 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-119763f5-063e-4741-a49a-dca55d58bc40 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:17.731409 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_cell0:SELECT=2 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:17.745943 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-68448945-8e88-42bc-b4f6-43611874546a req-f736390f-562a-4e87-b2d9-b0578a8cd0fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e417922-03b2-40d5-814a-4303948ed31b", "tag": "971e49f3-13e4-4d71-a577-21b1d36cef54"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:09:17.753794 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell0:SELECT=2 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:17.755105 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell0:SELECT=6 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:17.758372 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-119763f5-063e-4741-a49a-dca55d58bc40 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:17.759214 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-119763f5-063e-4741-a49a-dca55d58bc40 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:17.761601 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-119763f5-063e-4741-a49a-dca55d58bc40 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:17.762051 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-119763f5-063e-4741-a49a-dca55d58bc40 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:17.767027 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-68448945-8e88-42bc-b4f6-43611874546a req-f736390f-562a-4e87-b2d9-b0578a8cd0fc service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:17.770988 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-68448945-8e88-42bc-b4f6-43611874546a req-f736390f-562a-4e87-b2d9-b0578a8cd0fc service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:17.797631 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-68448945-8e88-42bc-b4f6-43611874546a req-f736390f-562a-4e87-b2d9-b0578a8cd0fc service nova] Creating event network-changed:971e49f3-13e4-4d71-a577-21b1d36cef54 for instance 8e417922-03b2-40d5-814a-4303948ed31b on hv-cinder-83607 May 26 18:09:17.803453 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-68448945-8e88-42bc-b4f6-43611874546a req-f736390f-562a-4e87-b2d9-b0578a8cd0fc service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060956 May 26 18:09:17.804216 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 495/1014] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:09:17.812673 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-119763f5-063e-4741-a49a-dca55d58bc40 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Going to try to terminate instance {{(pid=117722) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:09:17.939652 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-119763f5-063e-4741-a49a-dca55d58bc40 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "DELETE /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 204 len: 0 microversion: 2.1 time: 0.216247 May 26 18:09:17.940747 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 520/1015] 10.222.0.69 () {58 vars in 1238 bytes} [Thu May 26 18:09:17 2022] DELETE /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 18:09:17.953146 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-f4f8a437-d94a-4d03-9d88-ac3683da9b4d tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:17.954829 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-f4f8a437-d94a-4d03-9d88-ac3683da9b4d tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:17.968204 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f4f8a437-d94a-4d03-9d88-ac3683da9b4d tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:17.970432 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f4f8a437-d94a-4d03-9d88-ac3683da9b4d tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:17.972442 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f4f8a437-d94a-4d03-9d88-ac3683da9b4d tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:17.973490 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f4f8a437-d94a-4d03-9d88-ac3683da9b4d tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:18.078725 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-020c8570-3379-49a5-b902-c19e1ea0a8a3 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:18.080853 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-020c8570-3379-49a5-b902-c19e1ea0a8a3 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] [instance: 21aa42fa-cdba-45c2-a95d-f69ce2011540] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:18.090052 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-020c8570-3379-49a5-b902-c19e1ea0a8a3 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:18.090586 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-020c8570-3379-49a5-b902-c19e1ea0a8a3 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:18.091735 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-020c8570-3379-49a5-b902-c19e1ea0a8a3 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:18.092274 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-020c8570-3379-49a5-b902-c19e1ea0a8a3 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:18.175986 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-f4f8a437-d94a-4d03-9d88-ac3683da9b4d tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:18.184694 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-f4f8a437-d94a-4d03-9d88-ac3683da9b4d tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1567 microversion: 2.1 time: 0.238281 May 26 18:09:18.194966 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 496/1016] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:09:17 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1567 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:18.258802 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-020c8570-3379-49a5-b902-c19e1ea0a8a3 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab7e96c0db34764bc2ac1e20d0ac35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6805a7efbeb448d8bc42a86ff756071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:18.266677 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-020c8570-3379-49a5-b902-c19e1ea0a8a3 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] 10.222.0.69 "GET /compute/v2.1/servers/21aa42fa-cdba-45c2-a95d-f69ce2011540" status: 200 len: 1313 microversion: 2.1 time: 0.194649 May 26 18:09:18.267366 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 521/1017] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:09:18 2022] GET /compute/v2.1/servers/21aa42fa-cdba-45c2-a95d-f69ce2011540 => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:18.831914 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-69890869-787d-4c36-915d-1c18971e195f req-40039397-402a-467d-a7fb-106ab1bfd374 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21aa42fa-cdba-45c2-a95d-f69ce2011540", "name": "network-vif-plugged", "status": "completed", "tag": "052ea3c5-0c1f-41b5-88c9-a61595742690"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:09:18.842735 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-69890869-787d-4c36-915d-1c18971e195f req-40039397-402a-467d-a7fb-106ab1bfd374 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:18.843581 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-69890869-787d-4c36-915d-1c18971e195f req-40039397-402a-467d-a7fb-106ab1bfd374 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:18.860258 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-69890869-787d-4c36-915d-1c18971e195f req-40039397-402a-467d-a7fb-106ab1bfd374 service nova] Creating event network-vif-plugged:052ea3c5-0c1f-41b5-88c9-a61595742690 for instance 21aa42fa-cdba-45c2-a95d-f69ce2011540 on hv-cinder-83607 May 26 18:09:18.868993 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-69890869-787d-4c36-915d-1c18971e195f req-40039397-402a-467d-a7fb-106ab1bfd374 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040803 May 26 18:09:18.869949 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 497/1018] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:09:19.201805 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-beea7fb7-91cf-48b3-93ce-8f7710b62704 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:19.202425 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-beea7fb7-91cf-48b3-93ce-8f7710b62704 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:19.209588 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-beea7fb7-91cf-48b3-93ce-8f7710b62704 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:19.210046 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-beea7fb7-91cf-48b3-93ce-8f7710b62704 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:19.210829 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-beea7fb7-91cf-48b3-93ce-8f7710b62704 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:19.211268 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-beea7fb7-91cf-48b3-93ce-8f7710b62704 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:19.284684 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-b4e44fe6-014e-45e4-b007-a3e3a824c5ba tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:19.285410 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-b4e44fe6-014e-45e4-b007-a3e3a824c5ba tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] [instance: 21aa42fa-cdba-45c2-a95d-f69ce2011540] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:19.292124 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b4e44fe6-014e-45e4-b007-a3e3a824c5ba tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:19.292692 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b4e44fe6-014e-45e4-b007-a3e3a824c5ba tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:19.293557 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b4e44fe6-014e-45e4-b007-a3e3a824c5ba tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:19.294074 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b4e44fe6-014e-45e4-b007-a3e3a824c5ba tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:19.418204 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-beea7fb7-91cf-48b3-93ce-8f7710b62704 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:19.425873 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-beea7fb7-91cf-48b3-93ce-8f7710b62704 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1567 microversion: 2.1 time: 0.228001 May 26 18:09:19.426462 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 522/1019] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:09:19 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1567 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:19.438114 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-b4e44fe6-014e-45e4-b007-a3e3a824c5ba tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab7e96c0db34764bc2ac1e20d0ac35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6805a7efbeb448d8bc42a86ff756071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:19.446173 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-b4e44fe6-014e-45e4-b007-a3e3a824c5ba tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] 10.222.0.69 "GET /compute/v2.1/servers/21aa42fa-cdba-45c2-a95d-f69ce2011540" status: 200 len: 1313 microversion: 2.1 time: 0.166218 May 26 18:09:19.446743 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 498/1020] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:09:19 2022] GET /compute/v2.1/servers/21aa42fa-cdba-45c2-a95d-f69ce2011540 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:09:20.444038 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-fdbb2f7e-db3d-4bf9-b2fb-3fcf677cd035 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:20.444664 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-fdbb2f7e-db3d-4bf9-b2fb-3fcf677cd035 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:20.451460 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-fdbb2f7e-db3d-4bf9-b2fb-3fcf677cd035 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:20.451926 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-fdbb2f7e-db3d-4bf9-b2fb-3fcf677cd035 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:20.452742 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-fdbb2f7e-db3d-4bf9-b2fb-3fcf677cd035 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:20.453188 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-fdbb2f7e-db3d-4bf9-b2fb-3fcf677cd035 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:20.463372 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-95ed0896-f9b5-43a3-a832-754547789d27 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:20.463913 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-95ed0896-f9b5-43a3-a832-754547789d27 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] [instance: 21aa42fa-cdba-45c2-a95d-f69ce2011540] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:20.470868 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-95ed0896-f9b5-43a3-a832-754547789d27 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:20.471334 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-95ed0896-f9b5-43a3-a832-754547789d27 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:20.472156 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-95ed0896-f9b5-43a3-a832-754547789d27 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:20.472631 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-95ed0896-f9b5-43a3-a832-754547789d27 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:20.606129 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-fdbb2f7e-db3d-4bf9-b2fb-3fcf677cd035 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:20.614127 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-fdbb2f7e-db3d-4bf9-b2fb-3fcf677cd035 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1567 microversion: 2.1 time: 0.173985 May 26 18:09:20.614723 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 523/1021] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:09:20 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:20.620406 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-95ed0896-f9b5-43a3-a832-754547789d27 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab7e96c0db34764bc2ac1e20d0ac35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6805a7efbeb448d8bc42a86ff756071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:20.628173 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-95ed0896-f9b5-43a3-a832-754547789d27 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] 10.222.0.69 "GET /compute/v2.1/servers/21aa42fa-cdba-45c2-a95d-f69ce2011540" status: 200 len: 1313 microversion: 2.1 time: 0.169287 May 26 18:09:20.628735 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 499/1022] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:09:20 2022] GET /compute/v2.1/servers/21aa42fa-cdba-45c2-a95d-f69ce2011540 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:09:21.631701 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-f1527a0f-a353-4c69-82e4-5026d558e540 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:21.632405 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-f1527a0f-a353-4c69-82e4-5026d558e540 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:21.639125 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-f1527a0f-a353-4c69-82e4-5026d558e540 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:21.639583 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-f1527a0f-a353-4c69-82e4-5026d558e540 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:21.640399 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-f1527a0f-a353-4c69-82e4-5026d558e540 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:21.640841 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-f1527a0f-a353-4c69-82e4-5026d558e540 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:21.646208 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-4df7ca4c-aa65-4dd7-a40d-cb1e4735840b tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:21.647321 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-4df7ca4c-aa65-4dd7-a40d-cb1e4735840b tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] [instance: 21aa42fa-cdba-45c2-a95d-f69ce2011540] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:21.654857 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4df7ca4c-aa65-4dd7-a40d-cb1e4735840b tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:21.655397 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4df7ca4c-aa65-4dd7-a40d-cb1e4735840b tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:21.656697 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4df7ca4c-aa65-4dd7-a40d-cb1e4735840b tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:21.656843 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4df7ca4c-aa65-4dd7-a40d-cb1e4735840b tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:21.786566 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-f1527a0f-a353-4c69-82e4-5026d558e540 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:21.800625 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-f1527a0f-a353-4c69-82e4-5026d558e540 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1567 microversion: 2.1 time: 0.172689 May 26 18:09:21.801449 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 524/1023] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:09:21 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:21.803847 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-4df7ca4c-aa65-4dd7-a40d-cb1e4735840b tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab7e96c0db34764bc2ac1e20d0ac35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6805a7efbeb448d8bc42a86ff756071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:21.811886 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-4df7ca4c-aa65-4dd7-a40d-cb1e4735840b tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] 10.222.0.69 "GET /compute/v2.1/servers/21aa42fa-cdba-45c2-a95d-f69ce2011540" status: 200 len: 1313 microversion: 2.1 time: 0.169608 May 26 18:09:21.812483 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 500/1024] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:09:21 2022] GET /compute/v2.1/servers/21aa42fa-cdba-45c2-a95d-f69ce2011540 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:09:22.697447 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [req-15e5bf30-7a8c-4600-938b-b90b548feebc req-e30c685d-fa9b-4ef5-addb-26b3b05d2231 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e417922-03b2-40d5-814a-4303948ed31b", "name": "network-vif-deleted", "tag": "971e49f3-13e4-4d71-a577-21b1d36cef54"}]} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:09:22.706422 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-15e5bf30-7a8c-4600-938b-b90b548feebc req-e30c685d-fa9b-4ef5-addb-26b3b05d2231 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:22.706913 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-15e5bf30-7a8c-4600-938b-b90b548feebc req-e30c685d-fa9b-4ef5-addb-26b3b05d2231 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:22.719237 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.compute.server_external_events [req-15e5bf30-7a8c-4600-938b-b90b548feebc req-e30c685d-fa9b-4ef5-addb-26b3b05d2231 service nova] Creating event network-vif-deleted:971e49f3-13e4-4d71-a577-21b1d36cef54 for instance 8e417922-03b2-40d5-814a-4303948ed31b on hv-cinder-83607 May 26 18:09:22.724148 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [req-15e5bf30-7a8c-4600-938b-b90b548feebc req-e30c685d-fa9b-4ef5-addb-26b3b05d2231 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030565 May 26 18:09:22.724736 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 525/1025] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:09:22.818236 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-91987656-1b5e-4312-8571-61af0939eff0 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:22.819429 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-91987656-1b5e-4312-8571-61af0939eff0 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:22.827224 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-91987656-1b5e-4312-8571-61af0939eff0 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:22.827669 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-91987656-1b5e-4312-8571-61af0939eff0 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:22.828473 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-91987656-1b5e-4312-8571-61af0939eff0 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:22.828907 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-91987656-1b5e-4312-8571-61af0939eff0 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:22.829478 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-f544f676-4e04-4d2e-9aff-0315cc0291a5 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:22.830182 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-f544f676-4e04-4d2e-9aff-0315cc0291a5 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] [instance: 21aa42fa-cdba-45c2-a95d-f69ce2011540] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:22.837581 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-f544f676-4e04-4d2e-9aff-0315cc0291a5 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:22.838156 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-f544f676-4e04-4d2e-9aff-0315cc0291a5 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:22.838949 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-f544f676-4e04-4d2e-9aff-0315cc0291a5 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:22.839390 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-f544f676-4e04-4d2e-9aff-0315cc0291a5 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:22.896238 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-91987656-1b5e-4312-8571-61af0939eff0 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:22.905223 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-91987656-1b5e-4312-8571-61af0939eff0 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1219 microversion: 2.1 time: 0.090720 May 26 18:09:22.905844 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 501/1026] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:09:22 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:22.981639 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-f544f676-4e04-4d2e-9aff-0315cc0291a5 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab7e96c0db34764bc2ac1e20d0ac35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6805a7efbeb448d8bc42a86ff756071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:22.989490 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-f544f676-4e04-4d2e-9aff-0315cc0291a5 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] 10.222.0.69 "GET /compute/v2.1/servers/21aa42fa-cdba-45c2-a95d-f69ce2011540" status: 200 len: 1313 microversion: 2.1 time: 0.164243 May 26 18:09:22.990170 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 526/1027] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:09:22 2022] GET /compute/v2.1/servers/21aa42fa-cdba-45c2-a95d-f69ce2011540 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:23.922425 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-6404eb4e-bd3b-47b9-a03e-ce415edb68eb tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:23.923039 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-6404eb4e-bd3b-47b9-a03e-ce415edb68eb tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:23.929820 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6404eb4e-bd3b-47b9-a03e-ce415edb68eb tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:23.930282 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6404eb4e-bd3b-47b9-a03e-ce415edb68eb tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:23.931082 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6404eb4e-bd3b-47b9-a03e-ce415edb68eb tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:23.931536 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6404eb4e-bd3b-47b9-a03e-ce415edb68eb tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:23.999983 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-6404eb4e-bd3b-47b9-a03e-ce415edb68eb tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:24.008458 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-6404eb4e-bd3b-47b9-a03e-ce415edb68eb tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1219 microversion: 2.1 time: 0.089835 May 26 18:09:24.008964 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 502/1028] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:09:23 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:24.010950 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-5a6eb502-158a-4b6c-b700-f1e0429c6260 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:24.012135 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-5a6eb502-158a-4b6c-b700-f1e0429c6260 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] [instance: 21aa42fa-cdba-45c2-a95d-f69ce2011540] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:24.021178 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-5a6eb502-158a-4b6c-b700-f1e0429c6260 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:24.021685 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-5a6eb502-158a-4b6c-b700-f1e0429c6260 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:24.023079 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-5a6eb502-158a-4b6c-b700-f1e0429c6260 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:24.023564 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-5a6eb502-158a-4b6c-b700-f1e0429c6260 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:24.177994 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-5a6eb502-158a-4b6c-b700-f1e0429c6260 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab7e96c0db34764bc2ac1e20d0ac35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6805a7efbeb448d8bc42a86ff756071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:24.186090 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-5a6eb502-158a-4b6c-b700-f1e0429c6260 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] 10.222.0.69 "GET /compute/v2.1/servers/21aa42fa-cdba-45c2-a95d-f69ce2011540" status: 200 len: 1313 microversion: 2.1 time: 0.182769 May 26 18:09:24.186692 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 527/1029] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:09:24 2022] GET /compute/v2.1/servers/21aa42fa-cdba-45c2-a95d-f69ce2011540 => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:25.027558 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-5691096d-e94e-4ebf-8bf9-b8db45767ba2 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:25.028311 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-5691096d-e94e-4ebf-8bf9-b8db45767ba2 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:25.034947 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5691096d-e94e-4ebf-8bf9-b8db45767ba2 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:25.035505 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5691096d-e94e-4ebf-8bf9-b8db45767ba2 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:25.036911 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5691096d-e94e-4ebf-8bf9-b8db45767ba2 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:25.037692 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5691096d-e94e-4ebf-8bf9-b8db45767ba2 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:25.110419 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-5691096d-e94e-4ebf-8bf9-b8db45767ba2 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:25.119019 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-5691096d-e94e-4ebf-8bf9-b8db45767ba2 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1219 microversion: 2.1 time: 0.096792 May 26 18:09:25.119688 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 503/1030] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:09:25 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:25.207983 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-919d44a4-32b5-473e-8663-a7146489a14b tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:25.208740 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-919d44a4-32b5-473e-8663-a7146489a14b tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] [instance: 21aa42fa-cdba-45c2-a95d-f69ce2011540] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:25.217064 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-919d44a4-32b5-473e-8663-a7146489a14b tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:25.217537 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-919d44a4-32b5-473e-8663-a7146489a14b tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:25.218334 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-919d44a4-32b5-473e-8663-a7146489a14b tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:25.218778 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-919d44a4-32b5-473e-8663-a7146489a14b tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:25.361914 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-919d44a4-32b5-473e-8663-a7146489a14b tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab7e96c0db34764bc2ac1e20d0ac35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6805a7efbeb448d8bc42a86ff756071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:25.371116 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-919d44a4-32b5-473e-8663-a7146489a14b tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] 10.222.0.69 "GET /compute/v2.1/servers/21aa42fa-cdba-45c2-a95d-f69ce2011540" status: 200 len: 1313 microversion: 2.1 time: 0.167870 May 26 18:09:25.371705 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 528/1031] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:09:25 2022] GET /compute/v2.1/servers/21aa42fa-cdba-45c2-a95d-f69ce2011540 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:26.137833 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-37e22b8e-5aba-4ba0-ad90-e4654396a563 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:26.138534 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-37e22b8e-5aba-4ba0-ad90-e4654396a563 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:26.145675 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-37e22b8e-5aba-4ba0-ad90-e4654396a563 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:26.146204 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-37e22b8e-5aba-4ba0-ad90-e4654396a563 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:26.147027 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-37e22b8e-5aba-4ba0-ad90-e4654396a563 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:26.148361 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-37e22b8e-5aba-4ba0-ad90-e4654396a563 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:26.169066 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:26.218125 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-37e22b8e-5aba-4ba0-ad90-e4654396a563 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8a0ec84d3c471f9e6baa548f0d045a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce9015638524279b09969d5aacda2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:26.225799 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-37e22b8e-5aba-4ba0-ad90-e4654396a563 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 200 len: 1219 microversion: 2.1 time: 0.093671 May 26 18:09:26.226364 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 504/1032] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:09:26 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:26.389022 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-ee0ea9f6-8d5e-4a71-805c-52f7f61269ab tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:26.389736 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-ee0ea9f6-8d5e-4a71-805c-52f7f61269ab tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] [instance: 21aa42fa-cdba-45c2-a95d-f69ce2011540] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:26.396545 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ee0ea9f6-8d5e-4a71-805c-52f7f61269ab tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:26.396991 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ee0ea9f6-8d5e-4a71-805c-52f7f61269ab tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:26.398591 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ee0ea9f6-8d5e-4a71-805c-52f7f61269ab tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:26.399344 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ee0ea9f6-8d5e-4a71-805c-52f7f61269ab tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:26.556836 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-ee0ea9f6-8d5e-4a71-805c-52f7f61269ab tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab7e96c0db34764bc2ac1e20d0ac35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6805a7efbeb448d8bc42a86ff756071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:26.564780 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-ee0ea9f6-8d5e-4a71-805c-52f7f61269ab tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] 10.222.0.69 "GET /compute/v2.1/servers/21aa42fa-cdba-45c2-a95d-f69ce2011540" status: 200 len: 1496 microversion: 2.1 time: 0.179825 May 26 18:09:26.565379 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 529/1033] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:09:26 2022] GET /compute/v2.1/servers/21aa42fa-cdba-45c2-a95d-f69ce2011540 => generated 1496 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:27.025380 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-2a1a87ae-3662-4d38-9b2a-5567878b534a tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:27.025732 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-2a1a87ae-3662-4d38-9b2a-5567878b534a tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] [instance: 21aa42fa-cdba-45c2-a95d-f69ce2011540] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:27.035784 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2a1a87ae-3662-4d38-9b2a-5567878b534a tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:27.036302 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2a1a87ae-3662-4d38-9b2a-5567878b534a tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:27.037081 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2a1a87ae-3662-4d38-9b2a-5567878b534a tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:27.037522 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2a1a87ae-3662-4d38-9b2a-5567878b534a tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:27.069761 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-2a1a87ae-3662-4d38-9b2a-5567878b534a tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] [instance: 21aa42fa-cdba-45c2-a95d-f69ce2011540] Going to try to terminate instance {{(pid=117723) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:09:27.167674 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-2a1a87ae-3662-4d38-9b2a-5567878b534a tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] 10.222.0.69 "DELETE /compute/v2.1/servers/21aa42fa-cdba-45c2-a95d-f69ce2011540" status: 204 len: 0 microversion: 2.1 time: 0.146357 May 26 18:09:27.168685 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 505/1034] 10.222.0.69 () {58 vars in 1238 bytes} [Thu May 26 18:09:27 2022] DELETE /compute/v2.1/servers/21aa42fa-cdba-45c2-a95d-f69ce2011540 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 18:09:27.178221 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-63582f65-e325-44d4-b098-7ae9b94f6547 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:27.179259 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-63582f65-e325-44d4-b098-7ae9b94f6547 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] [instance: 21aa42fa-cdba-45c2-a95d-f69ce2011540] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:27.185579 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-63582f65-e325-44d4-b098-7ae9b94f6547 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:27.186620 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-63582f65-e325-44d4-b098-7ae9b94f6547 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:27.187589 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-63582f65-e325-44d4-b098-7ae9b94f6547 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:27.188233 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-63582f65-e325-44d4-b098-7ae9b94f6547 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:27.246422 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-61c90a37-6f9f-49dd-b2a4-999097a187d4 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:27.247158 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-61c90a37-6f9f-49dd-b2a4-999097a187d4 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] [instance: 8e417922-03b2-40d5-814a-4303948ed31b] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:27.256856 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-61c90a37-6f9f-49dd-b2a4-999097a187d4 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:27.258800 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-61c90a37-6f9f-49dd-b2a4-999097a187d4 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:27.260044 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-61c90a37-6f9f-49dd-b2a4-999097a187d4 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:27.260497 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-61c90a37-6f9f-49dd-b2a4-999097a187d4 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:27.278284 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.wsgi [None req-61c90a37-6f9f-49dd-b2a4-999097a187d4 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] HTTP exception thrown: Instance 8e417922-03b2-40d5-814a-4303948ed31b could not be found. May 26 18:09:27.279950 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-61c90a37-6f9f-49dd-b2a4-999097a187d4 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Request method failure captured: May 26 18:09:27.279950 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: request: GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b HTTP/1.1 May 26 18:09:27.279950 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Accept: application/json May 26 18:09:27.279950 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Accept-Encoding: identity May 26 18:09:27.279950 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Connection: close May 26 18:09:27.279950 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Content-Length: 0 May 26 18:09:27.279950 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Content-Type: application/json May 26 18:09:27.279950 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Host: 10.222.0.69 May 26 18:09:27.279950 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Openstack-System-Scope: None May 26 18:09:27.279950 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: User-Agent: python-urllib3/1.26.9 May 26 18:09:27.279950 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Auth-Token: gAAAAABij8EK4UftL244IZBbSzSAYxI9gcUU6pL2iQIqx6fkhdfXWYdyi74Qq7L8xT9GbROoHjqw-DB1iBk0WWy9G9US1kvK8d-sFdlft2_uvLY-eunUq3QNyCiZQ2WRFxRYOBxAu5SKJxkHMy0u5Mji2n1B9z6zMnSohW_7unRAMJWcGzxH4lY May 26 18:09:27.279950 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Domain-Id: None May 26 18:09:27.279950 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Domain-Name: None May 26 18:09:27.279950 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Identity-Status: Confirmed May 26 18:09:27.279950 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Is-Admin-Project: True May 26 18:09:27.279950 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Domain-Id: default May 26 18:09:27.279950 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Domain-Name: Default May 26 18:09:27.279950 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Id: fce9015638524279b09969d5aacda2ba May 26 18:09:27.279950 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Name: tempest-TestShelveInstance-360596940 May 26 18:09:27.279950 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Role: member,reader May 26 18:09:27.279950 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Roles: member,reader May 26 18:09:27.281872 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fce9015638524279b09969d5aacda2ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/fce9015638524279b09969d5aacda2ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fce9015638524279b09969d5aacda2ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_fce9015638524279b09969d5aacda2ba"}]}] May 26 18:09:27.281872 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant: tempest-TestShelveInstance-360596940 May 26 18:09:27.281872 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant-Id: fce9015638524279b09969d5aacda2ba May 26 18:09:27.281872 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant-Name: tempest-TestShelveInstance-360596940 May 26 18:09:27.281872 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User: tempest-TestShelveInstance-360596940-project May 26 18:09:27.281872 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Domain-Id: default May 26 18:09:27.281872 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Domain-Name: Default May 26 18:09:27.281872 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Id: 0c8a0ec84d3c471f9e6baa548f0d045a May 26 18:09:27.281872 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Name: tempest-TestShelveInstance-360596940-project May 26 18:09:27.281872 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: method: > May 26 18:09:27.281872 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: exception: Instance 8e417922-03b2-40d5-814a-4303948ed31b could not be found. May 26 18:09:27.281872 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: action_args: {'id': '8e417922-03b2-40d5-814a-4303948ed31b'} May 26 18:09:27.282741 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:09:27.282741 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:09:27.282741 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:09:27.282741 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:09:27.282741 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:09:27.282741 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:09:27.282741 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:09:27.282741 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:09:27.282741 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:09:27.282741 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:09:27.282741 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e417922-03b2-40d5-814a-4303948ed31b could not be found. May 26 18:09:27.282741 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:09:27.282741 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:09:27.282741 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:09:27.282741 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:09:27.282741 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:09:27.282741 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:09:27.282741 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:09:27.282741 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:09:27.282741 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:09:27.284307 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:09:27.284307 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:09:27.284307 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:09:27.284307 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:09:27.284307 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:09:27.284307 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:09:27.284307 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:09:27.284307 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e417922-03b2-40d5-814a-4303948ed31b could not be found. May 26 18:09:27.284307 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:09:27.284307 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:09:27.284307 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:09:27.284307 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:09:27.284307 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:09:27.284307 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:09:27.284307 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:09:27.284307 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:09:27.284307 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e417922-03b2-40d5-814a-4303948ed31b could not be found. May 26 18:09:27.284307 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:09:27.287914 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-61c90a37-6f9f-49dd-b2a4-999097a187d4 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Returning 404 to user: Instance 8e417922-03b2-40d5-814a-4303948ed31b could not be found. {{(pid=117723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:09:27.289310 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-61c90a37-6f9f-49dd-b2a4-999097a187d4 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b" status: 404 len: 111 microversion: 2.1 time: 0.048656 May 26 18:09:27.290052 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 506/1035] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:09:27 2022] GET /compute/v2.1/servers/8e417922-03b2-40d5-814a-4303948ed31b => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 18:09:27.369850 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-63582f65-e325-44d4-b098-7ae9b94f6547 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab7e96c0db34764bc2ac1e20d0ac35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6805a7efbeb448d8bc42a86ff756071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:27.378022 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-63582f65-e325-44d4-b098-7ae9b94f6547 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] 10.222.0.69 "GET /compute/v2.1/servers/21aa42fa-cdba-45c2-a95d-f69ce2011540" status: 200 len: 1502 microversion: 2.1 time: 0.204336 May 26 18:09:27.387152 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 530/1036] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:09:27 2022] GET /compute/v2.1/servers/21aa42fa-cdba-45c2-a95d-f69ce2011540 => generated 1502 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:27.480356 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-42332462-5f11-46e8-b454-849af7656324 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] Calling method '.version_select at 0x7f3abaa301f0>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:27.487389 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:27.501861 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-42332462-5f11-46e8-b454-849af7656324 tempest-TestShelveInstance-360596940 tempest-TestShelveInstance-360596940-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-631169157" status: 202 len: 0 microversion: 2.1 time: 0.026349 May 26 18:09:27.502734 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 507/1037] 10.222.0.69 () {58 vars in 1250 bytes} [Thu May 26 18:09:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-631169157 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:09:28.395678 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-2e0e30ed-d22d-467d-a482-2434b12cda93 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:28.396327 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-2e0e30ed-d22d-467d-a482-2434b12cda93 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] [instance: 21aa42fa-cdba-45c2-a95d-f69ce2011540] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:28.403871 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-2e0e30ed-d22d-467d-a482-2434b12cda93 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:28.404364 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-2e0e30ed-d22d-467d-a482-2434b12cda93 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:28.405140 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-2e0e30ed-d22d-467d-a482-2434b12cda93 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:28.405580 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-2e0e30ed-d22d-467d-a482-2434b12cda93 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:28.616339 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-2e0e30ed-d22d-467d-a482-2434b12cda93 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab7e96c0db34764bc2ac1e20d0ac35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6805a7efbeb448d8bc42a86ff756071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:28.625640 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-2e0e30ed-d22d-467d-a482-2434b12cda93 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] 10.222.0.69 "GET /compute/v2.1/servers/21aa42fa-cdba-45c2-a95d-f69ce2011540" status: 200 len: 1502 microversion: 2.1 time: 0.233360 May 26 18:09:28.626398 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 531/1038] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:09:28 2022] GET /compute/v2.1/servers/21aa42fa-cdba-45c2-a95d-f69ce2011540 => generated 1502 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:29.645404 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-e111f8bb-f9ed-426a-9897-f048558d5641 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:29.646689 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-e111f8bb-f9ed-426a-9897-f048558d5641 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] [instance: 21aa42fa-cdba-45c2-a95d-f69ce2011540] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:29.656844 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e111f8bb-f9ed-426a-9897-f048558d5641 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:29.657692 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e111f8bb-f9ed-426a-9897-f048558d5641 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:29.658695 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e111f8bb-f9ed-426a-9897-f048558d5641 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:29.659354 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e111f8bb-f9ed-426a-9897-f048558d5641 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:29.822209 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-e111f8bb-f9ed-426a-9897-f048558d5641 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab7e96c0db34764bc2ac1e20d0ac35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6805a7efbeb448d8bc42a86ff756071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:29.830084 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-e111f8bb-f9ed-426a-9897-f048558d5641 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] 10.222.0.69 "GET /compute/v2.1/servers/21aa42fa-cdba-45c2-a95d-f69ce2011540" status: 200 len: 1502 microversion: 2.1 time: 0.190542 May 26 18:09:29.830669 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 508/1039] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:09:29 2022] GET /compute/v2.1/servers/21aa42fa-cdba-45c2-a95d-f69ce2011540 => generated 1502 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:30.848414 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-8e284afb-c457-4628-b753-5b0a8e68498a tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:30.850017 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-8e284afb-c457-4628-b753-5b0a8e68498a tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] [instance: 21aa42fa-cdba-45c2-a95d-f69ce2011540] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:30.858518 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-8e284afb-c457-4628-b753-5b0a8e68498a tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:30.859556 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-8e284afb-c457-4628-b753-5b0a8e68498a tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:30.860576 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-8e284afb-c457-4628-b753-5b0a8e68498a tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:30.861265 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-8e284afb-c457-4628-b753-5b0a8e68498a tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:31.203322 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-8e284afb-c457-4628-b753-5b0a8e68498a tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab7e96c0db34764bc2ac1e20d0ac35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6805a7efbeb448d8bc42a86ff756071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:31.214583 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-8e284afb-c457-4628-b753-5b0a8e68498a tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] 10.222.0.69 "GET /compute/v2.1/servers/21aa42fa-cdba-45c2-a95d-f69ce2011540" status: 200 len: 1502 microversion: 2.1 time: 0.368167 May 26 18:09:31.215220 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 532/1040] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:09:30 2022] GET /compute/v2.1/servers/21aa42fa-cdba-45c2-a95d-f69ce2011540 => generated 1502 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:32.061357 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-86de9692-8b9f-4483-a551-fc6de1c06bfe req-b2f0dcb7-4fac-445e-a972-b4ba2adbd193 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21aa42fa-cdba-45c2-a95d-f69ce2011540", "name": "network-vif-deleted", "tag": "052ea3c5-0c1f-41b5-88c9-a61595742690"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:09:32.071635 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-86de9692-8b9f-4483-a551-fc6de1c06bfe req-b2f0dcb7-4fac-445e-a972-b4ba2adbd193 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:32.072110 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-86de9692-8b9f-4483-a551-fc6de1c06bfe req-b2f0dcb7-4fac-445e-a972-b4ba2adbd193 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:32.083991 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-86de9692-8b9f-4483-a551-fc6de1c06bfe req-b2f0dcb7-4fac-445e-a972-b4ba2adbd193 service nova] Creating event network-vif-deleted:052ea3c5-0c1f-41b5-88c9-a61595742690 for instance 21aa42fa-cdba-45c2-a95d-f69ce2011540 on hv-cinder-83607 May 26 18:09:32.090373 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-86de9692-8b9f-4483-a551-fc6de1c06bfe req-b2f0dcb7-4fac-445e-a972-b4ba2adbd193 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032721 May 26 18:09:32.091174 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 509/1041] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:09:32.231749 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-2a21a8f5-e251-497e-a16b-c417bd19b9f8 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:32.232488 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-2a21a8f5-e251-497e-a16b-c417bd19b9f8 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] [instance: 21aa42fa-cdba-45c2-a95d-f69ce2011540] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:32.239164 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-2a21a8f5-e251-497e-a16b-c417bd19b9f8 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:32.239730 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-2a21a8f5-e251-497e-a16b-c417bd19b9f8 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:32.240607 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-2a21a8f5-e251-497e-a16b-c417bd19b9f8 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:32.241124 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-2a21a8f5-e251-497e-a16b-c417bd19b9f8 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:32.305493 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-2a21a8f5-e251-497e-a16b-c417bd19b9f8 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab7e96c0db34764bc2ac1e20d0ac35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6805a7efbeb448d8bc42a86ff756071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:32.309451 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:32.314476 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-2a21a8f5-e251-497e-a16b-c417bd19b9f8 tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] 10.222.0.69 "GET /compute/v2.1/servers/21aa42fa-cdba-45c2-a95d-f69ce2011540" status: 200 len: 1298 microversion: 2.1 time: 0.086976 May 26 18:09:32.315065 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 533/1042] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:09:32 2022] GET /compute/v2.1/servers/21aa42fa-cdba-45c2-a95d-f69ce2011540 => generated 1298 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:33.334485 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-e355f58a-3d14-40c0-89f4-65f4636f3b1c tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:33.335325 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-e355f58a-3d14-40c0-89f4-65f4636f3b1c tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] [instance: 21aa42fa-cdba-45c2-a95d-f69ce2011540] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:33.343348 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e355f58a-3d14-40c0-89f4-65f4636f3b1c tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:33.344237 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e355f58a-3d14-40c0-89f4-65f4636f3b1c tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:33.345482 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e355f58a-3d14-40c0-89f4-65f4636f3b1c tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:33.346161 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e355f58a-3d14-40c0-89f4-65f4636f3b1c tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:33.388576 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e355f58a-3d14-40c0-89f4-65f4636f3b1c tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:33.389030 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e355f58a-3d14-40c0-89f4-65f4636f3b1c tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:33.389681 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.objects.instance [None req-e355f58a-3d14-40c0-89f4-65f4636f3b1c tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lazy-loading 'fault' on Instance uuid 21aa42fa-cdba-45c2-a95d-f69ce2011540 {{(pid=117723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:09:33.451466 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-e355f58a-3d14-40c0-89f4-65f4636f3b1c tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab7e96c0db34764bc2ac1e20d0ac35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6805a7efbeb448d8bc42a86ff756071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:33.461662 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-e355f58a-3d14-40c0-89f4-65f4636f3b1c tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] 10.222.0.69 "GET /compute/v2.1/servers/21aa42fa-cdba-45c2-a95d-f69ce2011540" status: 200 len: 1303 microversion: 2.1 time: 0.131468 May 26 18:09:33.472441 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 510/1043] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:09:33 2022] GET /compute/v2.1/servers/21aa42fa-cdba-45c2-a95d-f69ce2011540 => generated 1303 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:09:34.480337 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-c2ede82e-c9b6-4a7c-8e55-b1973736819f tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:34.482278 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-c2ede82e-c9b6-4a7c-8e55-b1973736819f tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] [instance: 21aa42fa-cdba-45c2-a95d-f69ce2011540] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:34.490539 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c2ede82e-c9b6-4a7c-8e55-b1973736819f tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:34.491426 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c2ede82e-c9b6-4a7c-8e55-b1973736819f tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:34.493038 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c2ede82e-c9b6-4a7c-8e55-b1973736819f tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:34.493731 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c2ede82e-c9b6-4a7c-8e55-b1973736819f tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:34.517673 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.wsgi [None req-c2ede82e-c9b6-4a7c-8e55-b1973736819f tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] HTTP exception thrown: Instance 21aa42fa-cdba-45c2-a95d-f69ce2011540 could not be found. May 26 18:09:34.519365 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-c2ede82e-c9b6-4a7c-8e55-b1973736819f tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Request method failure captured: May 26 18:09:34.519365 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: request: GET /compute/v2.1/servers/21aa42fa-cdba-45c2-a95d-f69ce2011540 HTTP/1.1 May 26 18:09:34.519365 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Accept: application/json May 26 18:09:34.519365 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Accept-Encoding: identity May 26 18:09:34.519365 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Connection: close May 26 18:09:34.519365 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Content-Length: 0 May 26 18:09:34.519365 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Content-Type: application/json May 26 18:09:34.519365 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Host: 10.222.0.69 May 26 18:09:34.519365 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Openstack-System-Scope: None May 26 18:09:34.519365 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: User-Agent: python-urllib3/1.26.9 May 26 18:09:34.519365 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Auth-Token: gAAAAABij8IvVEMljEaXjz0RAWQSsvvu0NXquqAWiqaqLUn3z2fX3THmI51LLtDwqh7GOPiZEQBiDM9jwFzHRN1D7hFtuTdIRHaLTsNbTXY6tCGqc8x_ToFaG3ANpZMpBH7fI_eqT43H9fUQNpQRlN6b2YXSyyFlbI8fy8R1PnINGMexwpPk2ug May 26 18:09:34.519365 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Domain-Id: None May 26 18:09:34.519365 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Domain-Name: None May 26 18:09:34.519365 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Identity-Status: Confirmed May 26 18:09:34.519365 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Is-Admin-Project: True May 26 18:09:34.519365 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Domain-Id: default May 26 18:09:34.519365 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Domain-Name: Default May 26 18:09:34.519365 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Id: f6805a7efbeb448d8bc42a86ff756071 May 26 18:09:34.519365 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Name: tempest-VolumesActionsTest-688175260 May 26 18:09:34.519365 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Role: member,reader May 26 18:09:34.519365 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Roles: member,reader May 26 18:09:34.533534 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f6805a7efbeb448d8bc42a86ff756071"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f6805a7efbeb448d8bc42a86ff756071"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f6805a7efbeb448d8bc42a86ff756071"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f6805a7efbeb448d8bc42a86ff756071"}]}] May 26 18:09:34.533534 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant: tempest-VolumesActionsTest-688175260 May 26 18:09:34.533534 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant-Id: f6805a7efbeb448d8bc42a86ff756071 May 26 18:09:34.533534 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant-Name: tempest-VolumesActionsTest-688175260 May 26 18:09:34.533534 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User: tempest-VolumesActionsTest-688175260-project May 26 18:09:34.533534 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Domain-Id: default May 26 18:09:34.533534 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Domain-Name: Default May 26 18:09:34.533534 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Id: 6ab7e96c0db34764bc2ac1e20d0ac35e May 26 18:09:34.533534 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Name: tempest-VolumesActionsTest-688175260-project May 26 18:09:34.533534 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: method: > May 26 18:09:34.533534 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: exception: Instance 21aa42fa-cdba-45c2-a95d-f69ce2011540 could not be found. May 26 18:09:34.533534 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: action_args: {'id': '21aa42fa-cdba-45c2-a95d-f69ce2011540'} May 26 18:09:34.535000 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:09:34.535000 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:09:34.535000 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:09:34.535000 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:09:34.535000 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:09:34.535000 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:09:34.535000 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:09:34.535000 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:09:34.535000 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:09:34.535000 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:09:34.535000 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21aa42fa-cdba-45c2-a95d-f69ce2011540 could not be found. May 26 18:09:34.535000 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:09:34.535000 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:09:34.535000 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:09:34.535000 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:09:34.535000 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:09:34.535000 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:09:34.535000 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:09:34.535000 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:09:34.535000 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:09:34.536279 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:09:34.536279 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:09:34.536279 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:09:34.536279 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:09:34.536279 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:09:34.536279 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:09:34.536279 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:09:34.536279 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21aa42fa-cdba-45c2-a95d-f69ce2011540 could not be found. May 26 18:09:34.536279 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:09:34.536279 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:09:34.536279 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:09:34.536279 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:09:34.536279 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:09:34.536279 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:09:34.536279 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:09:34.536279 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:09:34.536279 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21aa42fa-cdba-45c2-a95d-f69ce2011540 could not be found. May 26 18:09:34.536279 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:09:34.537399 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-c2ede82e-c9b6-4a7c-8e55-b1973736819f tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] Returning 404 to user: Instance 21aa42fa-cdba-45c2-a95d-f69ce2011540 could not be found. {{(pid=117722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:09:34.537399 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-c2ede82e-c9b6-4a7c-8e55-b1973736819f tempest-VolumesActionsTest-688175260 tempest-VolumesActionsTest-688175260-project] 10.222.0.69 "GET /compute/v2.1/servers/21aa42fa-cdba-45c2-a95d-f69ce2011540" status: 404 len: 111 microversion: 2.1 time: 0.045845 May 26 18:09:34.537399 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 534/1044] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:09:34 2022] GET /compute/v2.1/servers/21aa42fa-cdba-45c2-a95d-f69ce2011540 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:10:35.935518 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:35.936314 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:35.941945 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-53a1bbed-8666-493a-bb18-74eb80d9a1c7 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Action: 'create', calling method: .version_select at 0x7f3ab8c04790>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1007566241", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMBWFR153ss//11UKPdxnYFER+VhYSnqdWPMbYG8kt15P8Bytmy8GfAJAUOhMe6qK5tlVYvVq40tr+rHzCCYRTH960OPiE+W1wySTD0ix7nf8cAZfsDZRmnB79jLttrVxg=="}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:10:35.960695 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-53a1bbed-8666-493a-bb18-74eb80d9a1c7 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Getting quotas for project 5eefb86101fe49f9953595f91d4a790a. Resources: {'key_pairs'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:10:35.965209 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-53a1bbed-8666-493a-bb18-74eb80d9a1c7 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Getting quotas for user e6d5c34aba8047e593b32ec34ab7fba9 and project 5eefb86101fe49f9953595f91d4a790a. Resources: {'key_pairs'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:10:35.998293 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-53a1bbed-8666-493a-bb18-74eb80d9a1c7 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.064594 May 26 18:10:35.998917 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 511/1045] 10.222.0.69 () {60 vars in 1158 bytes} [Thu May 26 18:10:35 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:10:36.127785 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:36.129077 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_cell1:SELECT=2 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:36.133341 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-81341ffe-d538-4333-b4eb-75b9342d0947 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-994040412", "imageRef": "d43ad9fd-3212-4a1f-a00e-680d545f7682", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1007566241", "networks": [{"uuid": "020506e2-f56f-41a0-9d9c-dd9831f11549"}]}} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:10:36.189792 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.network.neutron [None req-81341ffe-d538-4333-b4eb-75b9342d0947 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] validate_networks() for [('020506e2-f56f-41a0-9d9c-dd9831f11549', None, None, None, None, None)] {{(pid=117722) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:10:36.636323 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.virt.hardware [None req-81341ffe-d538-4333-b4eb-75b9342d0947 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Flavor limits 0:0:0 {{(pid=117722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:10:36.637028 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.virt.hardware [None req-81341ffe-d538-4333-b4eb-75b9342d0947 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Image limits 0:0:0 {{(pid=117722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:10:36.637836 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.virt.hardware [None req-81341ffe-d538-4333-b4eb-75b9342d0947 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Flavor pref 0:0:0 {{(pid=117722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:10:36.638549 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.virt.hardware [None req-81341ffe-d538-4333-b4eb-75b9342d0947 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Image pref 0:0:0 {{(pid=117722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:10:36.638983 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.virt.hardware [None req-81341ffe-d538-4333-b4eb-75b9342d0947 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:10:36.651202 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-81341ffe-d538-4333-b4eb-75b9342d0947 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:36.651843 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-81341ffe-d538-4333-b4eb-75b9342d0947 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:36.662980 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-81341ffe-d538-4333-b4eb-75b9342d0947 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:36.663631 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-81341ffe-d538-4333-b4eb-75b9342d0947 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:36.686693 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.quota [None req-81341ffe-d538-4333-b4eb-75b9342d0947 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Getting quotas for project 5eefb86101fe49f9953595f91d4a790a. Resources: {'instances', 'ram', 'cores'} {{(pid=117722) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:10:36.693200 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.quota [None req-81341ffe-d538-4333-b4eb-75b9342d0947 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Getting quotas for user e6d5c34aba8047e593b32ec34ab7fba9 and project 5eefb86101fe49f9953595f91d4a790a. Resources: {'instances', 'ram', 'cores'} {{(pid=117722) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:10:36.708231 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-81341ffe-d538-4333-b4eb-75b9342d0947 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Going to run 1 instances... {{(pid=117722) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:10:36.710730 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-81341ffe-d538-4333-b4eb-75b9342d0947 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] [instance: 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d43ad9fd-3212-4a1f-a00e-680d545f7682',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:10:36.764514 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-81341ffe-d538-4333-b4eb-75b9342d0947 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.638221 May 26 18:10:36.766374 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 535/1046] 10.222.0.69 () {60 vars in 1146 bytes} [Thu May 26 18:10:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 26 18:10:36.777269 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-78d5dec7-73b4-42ea-91c9-704e75d7e4be tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:36.778067 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-78d5dec7-73b4-42ea-91c9-704e75d7e4be tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] [instance: 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:36.836731 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-78d5dec7-73b4-42ea-91c9-704e75d7e4be tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d5c34aba8047e593b32ec34ab7fba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eefb86101fe49f9953595f91d4a790a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:36.844513 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-78d5dec7-73b4-42ea-91c9-704e75d7e4be tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] 10.222.0.69 "GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a" status: 200 len: 1258 microversion: 2.1 time: 0.071360 May 26 18:10:36.845100 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 512/1047] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:10:36 2022] GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a => generated 1258 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:37.871668 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-7f708dee-679f-4f14-a78b-30d9e5048b6f tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:37.872974 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-7f708dee-679f-4f14-a78b-30d9e5048b6f tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] [instance: 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:37.880561 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7f708dee-679f-4f14-a78b-30d9e5048b6f tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:37.881457 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7f708dee-679f-4f14-a78b-30d9e5048b6f tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:37.882551 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7f708dee-679f-4f14-a78b-30d9e5048b6f tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:37.883169 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7f708dee-679f-4f14-a78b-30d9e5048b6f tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:37.982241 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-7f708dee-679f-4f14-a78b-30d9e5048b6f tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d5c34aba8047e593b32ec34ab7fba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eefb86101fe49f9953595f91d4a790a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:37.992657 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-7f708dee-679f-4f14-a78b-30d9e5048b6f tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] 10.222.0.69 "GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a" status: 200 len: 1328 microversion: 2.1 time: 0.125469 May 26 18:10:37.993256 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 536/1048] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:10:37 2022] GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a => generated 1328 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:39.017331 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-44c1df1e-a9fa-4879-8d70-28ff419bc681 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:39.019733 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-44c1df1e-a9fa-4879-8d70-28ff419bc681 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] [instance: 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:39.038505 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-44c1df1e-a9fa-4879-8d70-28ff419bc681 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:39.039620 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-44c1df1e-a9fa-4879-8d70-28ff419bc681 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:39.041474 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-44c1df1e-a9fa-4879-8d70-28ff419bc681 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:39.042571 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-44c1df1e-a9fa-4879-8d70-28ff419bc681 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:39.361542 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-44c1df1e-a9fa-4879-8d70-28ff419bc681 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d5c34aba8047e593b32ec34ab7fba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eefb86101fe49f9953595f91d4a790a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:39.369882 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-44c1df1e-a9fa-4879-8d70-28ff419bc681 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] 10.222.0.69 "GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a" status: 200 len: 1358 microversion: 2.1 time: 0.362529 May 26 18:10:39.370617 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 513/1049] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:10:39 2022] GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a => generated 1358 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:40.393635 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-13f8e9e9-85c2-4c7c-aeb4-3a1e59c72f92 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:40.395124 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-13f8e9e9-85c2-4c7c-aeb4-3a1e59c72f92 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] [instance: 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:40.411484 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-13f8e9e9-85c2-4c7c-aeb4-3a1e59c72f92 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:40.412301 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-13f8e9e9-85c2-4c7c-aeb4-3a1e59c72f92 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:40.413343 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-13f8e9e9-85c2-4c7c-aeb4-3a1e59c72f92 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:40.413950 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-13f8e9e9-85c2-4c7c-aeb4-3a1e59c72f92 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:40.606481 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-13f8e9e9-85c2-4c7c-aeb4-3a1e59c72f92 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d5c34aba8047e593b32ec34ab7fba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eefb86101fe49f9953595f91d4a790a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:40.623070 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-13f8e9e9-85c2-4c7c-aeb4-3a1e59c72f92 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] 10.222.0.69 "GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a" status: 200 len: 1358 microversion: 2.1 time: 0.237472 May 26 18:10:40.624101 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 537/1050] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:10:40 2022] GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a => generated 1358 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:41.647946 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-bdad8760-1222-4902-889c-293b2ce36de8 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:41.648985 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-bdad8760-1222-4902-889c-293b2ce36de8 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] [instance: 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:41.678520 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-bdad8760-1222-4902-889c-293b2ce36de8 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:41.679776 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-bdad8760-1222-4902-889c-293b2ce36de8 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:41.681226 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-bdad8760-1222-4902-889c-293b2ce36de8 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:41.682025 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-bdad8760-1222-4902-889c-293b2ce36de8 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:42.256832 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-bdad8760-1222-4902-889c-293b2ce36de8 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d5c34aba8047e593b32ec34ab7fba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eefb86101fe49f9953595f91d4a790a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:42.270267 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-bdad8760-1222-4902-889c-293b2ce36de8 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] 10.222.0.69 "GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a" status: 200 len: 1358 microversion: 2.1 time: 0.625322 May 26 18:10:42.271617 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 514/1051] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:10:41 2022] GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a => generated 1358 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:43.296089 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-77ff2d66-f6be-4008-bf15-44d6faec42e6 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:43.296089 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-77ff2d66-f6be-4008-bf15-44d6faec42e6 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] [instance: 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:43.298484 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-77ff2d66-f6be-4008-bf15-44d6faec42e6 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:43.299390 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-77ff2d66-f6be-4008-bf15-44d6faec42e6 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:43.300238 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-77ff2d66-f6be-4008-bf15-44d6faec42e6 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:43.300734 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-77ff2d66-f6be-4008-bf15-44d6faec42e6 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:43.466094 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-77ff2d66-f6be-4008-bf15-44d6faec42e6 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d5c34aba8047e593b32ec34ab7fba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eefb86101fe49f9953595f91d4a790a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:43.478799 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-77ff2d66-f6be-4008-bf15-44d6faec42e6 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] 10.222.0.69 "GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a" status: 200 len: 1358 microversion: 2.1 time: 0.193958 May 26 18:10:43.483759 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 538/1052] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:10:43 2022] GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a => generated 1358 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:44.498582 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-b56f0dd1-6755-4887-8d9a-b2ffe0a23362 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:44.504901 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-b56f0dd1-6755-4887-8d9a-b2ffe0a23362 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] [instance: 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:44.512466 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b56f0dd1-6755-4887-8d9a-b2ffe0a23362 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:44.513053 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b56f0dd1-6755-4887-8d9a-b2ffe0a23362 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:44.513977 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b56f0dd1-6755-4887-8d9a-b2ffe0a23362 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:44.514453 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b56f0dd1-6755-4887-8d9a-b2ffe0a23362 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:44.797799 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-b56f0dd1-6755-4887-8d9a-b2ffe0a23362 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d5c34aba8047e593b32ec34ab7fba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eefb86101fe49f9953595f91d4a790a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:44.806153 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-b56f0dd1-6755-4887-8d9a-b2ffe0a23362 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] 10.222.0.69 "GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a" status: 200 len: 1358 microversion: 2.1 time: 0.312221 May 26 18:10:44.807888 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 515/1053] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:10:44 2022] GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a => generated 1358 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:45.827386 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-7c7b02d8-32d3-4de7-b966-29fa71d5a966 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:45.828056 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-7c7b02d8-32d3-4de7-b966-29fa71d5a966 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] [instance: 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:45.837091 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7c7b02d8-32d3-4de7-b966-29fa71d5a966 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:45.838094 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7c7b02d8-32d3-4de7-b966-29fa71d5a966 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:45.839003 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7c7b02d8-32d3-4de7-b966-29fa71d5a966 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:45.839460 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-7c7b02d8-32d3-4de7-b966-29fa71d5a966 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:46.037168 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-7c7b02d8-32d3-4de7-b966-29fa71d5a966 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d5c34aba8047e593b32ec34ab7fba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eefb86101fe49f9953595f91d4a790a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:46.046656 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-7c7b02d8-32d3-4de7-b966-29fa71d5a966 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] 10.222.0.69 "GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a" status: 200 len: 1358 microversion: 2.1 time: 0.224808 May 26 18:10:46.047314 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 539/1054] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:10:45 2022] GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a => generated 1358 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:10:47.070243 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-8ab58dc4-71df-478b-85b4-0c071086f77c tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:47.070985 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-8ab58dc4-71df-478b-85b4-0c071086f77c tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] [instance: 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:47.074174 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell0:SELECT=6 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:47.083520 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8ab58dc4-71df-478b-85b4-0c071086f77c tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:47.084212 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8ab58dc4-71df-478b-85b4-0c071086f77c tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:47.085444 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8ab58dc4-71df-478b-85b4-0c071086f77c tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:47.086092 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8ab58dc4-71df-478b-85b4-0c071086f77c tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:47.363464 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-8ab58dc4-71df-478b-85b4-0c071086f77c tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d5c34aba8047e593b32ec34ab7fba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eefb86101fe49f9953595f91d4a790a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:47.372072 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-8ab58dc4-71df-478b-85b4-0c071086f77c tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] 10.222.0.69 "GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a" status: 200 len: 1358 microversion: 2.1 time: 0.307199 May 26 18:10:47.372692 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 516/1055] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:10:47 2022] GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a => generated 1358 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:47.882347 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [req-460748ab-7b32-49df-94b2-e0354fc1e8fb req-57811922-f81b-42f8-9465-5576820fceb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a", "tag": "c59057e8-e60b-4afe-bee1-1f39250eb63e"}]} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:10:47.903977 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_cell0:SELECT=2 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:47.905521 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_cell0:SELECT=6 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:47.915794 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-460748ab-7b32-49df-94b2-e0354fc1e8fb req-57811922-f81b-42f8-9465-5576820fceb8 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:47.916270 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-460748ab-7b32-49df-94b2-e0354fc1e8fb req-57811922-f81b-42f8-9465-5576820fceb8 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:47.929522 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.compute.server_external_events [req-460748ab-7b32-49df-94b2-e0354fc1e8fb req-57811922-f81b-42f8-9465-5576820fceb8 service nova] Creating event network-changed:c59057e8-e60b-4afe-bee1-1f39250eb63e for instance 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a on hv-cinder-83607 May 26 18:10:47.935750 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [req-460748ab-7b32-49df-94b2-e0354fc1e8fb req-57811922-f81b-42f8-9465-5576820fceb8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060102 May 26 18:10:47.937138 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 540/1056] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:10:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:10:48.392906 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-32160b21-b428-49d1-9dab-fe02faa79222 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:48.393480 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-32160b21-b428-49d1-9dab-fe02faa79222 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] [instance: 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:48.400483 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-32160b21-b428-49d1-9dab-fe02faa79222 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:48.400950 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-32160b21-b428-49d1-9dab-fe02faa79222 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:48.401737 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-32160b21-b428-49d1-9dab-fe02faa79222 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:48.402186 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-32160b21-b428-49d1-9dab-fe02faa79222 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:48.550710 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-32160b21-b428-49d1-9dab-fe02faa79222 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d5c34aba8047e593b32ec34ab7fba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eefb86101fe49f9953595f91d4a790a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:48.559020 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-32160b21-b428-49d1-9dab-fe02faa79222 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] 10.222.0.69 "GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a" status: 200 len: 1358 microversion: 2.1 time: 0.171815 May 26 18:10:48.559609 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 517/1057] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:10:48 2022] GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:49.578600 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-581f6d5c-9415-4449-8653-f0538c00ceac tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:49.580389 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-581f6d5c-9415-4449-8653-f0538c00ceac tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] [instance: 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:49.587855 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-581f6d5c-9415-4449-8653-f0538c00ceac tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:49.588352 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-581f6d5c-9415-4449-8653-f0538c00ceac tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:49.589296 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-581f6d5c-9415-4449-8653-f0538c00ceac tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:49.589814 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-581f6d5c-9415-4449-8653-f0538c00ceac tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:49.792255 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-581f6d5c-9415-4449-8653-f0538c00ceac tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d5c34aba8047e593b32ec34ab7fba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eefb86101fe49f9953595f91d4a790a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:49.809445 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-581f6d5c-9415-4449-8653-f0538c00ceac tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] 10.222.0.69 "GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a" status: 200 len: 1358 microversion: 2.1 time: 0.235591 May 26 18:10:49.810614 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 541/1058] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:10:49 2022] GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a => generated 1358 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:50.835486 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-f63c150b-0035-477d-a6d1-cb153fcb3490 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:50.836441 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-f63c150b-0035-477d-a6d1-cb153fcb3490 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] [instance: 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:50.843343 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f63c150b-0035-477d-a6d1-cb153fcb3490 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:50.843803 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f63c150b-0035-477d-a6d1-cb153fcb3490 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:50.845168 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f63c150b-0035-477d-a6d1-cb153fcb3490 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:50.845624 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f63c150b-0035-477d-a6d1-cb153fcb3490 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:51.002612 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-f63c150b-0035-477d-a6d1-cb153fcb3490 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d5c34aba8047e593b32ec34ab7fba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eefb86101fe49f9953595f91d4a790a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:51.011743 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-f63c150b-0035-477d-a6d1-cb153fcb3490 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] 10.222.0.69 "GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a" status: 200 len: 1358 microversion: 2.1 time: 0.180420 May 26 18:10:51.012514 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 518/1059] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:10:50 2022] GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:52.030111 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-ed896d2c-5851-4805-bb3f-8c455bd2d278 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:52.030753 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-ed896d2c-5851-4805-bb3f-8c455bd2d278 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] [instance: 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:52.038905 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ed896d2c-5851-4805-bb3f-8c455bd2d278 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:52.039351 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ed896d2c-5851-4805-bb3f-8c455bd2d278 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:52.040164 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ed896d2c-5851-4805-bb3f-8c455bd2d278 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:52.040601 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-ed896d2c-5851-4805-bb3f-8c455bd2d278 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:52.185736 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-ed896d2c-5851-4805-bb3f-8c455bd2d278 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d5c34aba8047e593b32ec34ab7fba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eefb86101fe49f9953595f91d4a790a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:52.197419 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-ed896d2c-5851-4805-bb3f-8c455bd2d278 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] 10.222.0.69 "GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a" status: 200 len: 1358 microversion: 2.1 time: 0.170829 May 26 18:10:52.198315 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 542/1060] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:10:52 2022] GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:52.616645 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-6de259f1-aeac-4a22-947a-6c5c8bcd657c req-bd9dea96-6b6c-4d38-89d7-4b6d2efe2da1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a", "name": "network-vif-plugged", "status": "completed", "tag": "c59057e8-e60b-4afe-bee1-1f39250eb63e"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:10:52.628663 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-6de259f1-aeac-4a22-947a-6c5c8bcd657c req-bd9dea96-6b6c-4d38-89d7-4b6d2efe2da1 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:52.629262 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-6de259f1-aeac-4a22-947a-6c5c8bcd657c req-bd9dea96-6b6c-4d38-89d7-4b6d2efe2da1 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:52.642161 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-6de259f1-aeac-4a22-947a-6c5c8bcd657c req-bd9dea96-6b6c-4d38-89d7-4b6d2efe2da1 service nova] Creating event network-vif-plugged:c59057e8-e60b-4afe-bee1-1f39250eb63e for instance 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a on hv-cinder-83607 May 26 18:10:52.647658 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-6de259f1-aeac-4a22-947a-6c5c8bcd657c req-bd9dea96-6b6c-4d38-89d7-4b6d2efe2da1 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035942 May 26 18:10:52.648314 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 519/1061] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:10:53.215982 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-34f59714-4889-44d4-b974-85f4145d1b83 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:53.216639 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-34f59714-4889-44d4-b974-85f4145d1b83 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] [instance: 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:53.224315 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-34f59714-4889-44d4-b974-85f4145d1b83 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:53.224774 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-34f59714-4889-44d4-b974-85f4145d1b83 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:53.225571 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-34f59714-4889-44d4-b974-85f4145d1b83 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:53.226013 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-34f59714-4889-44d4-b974-85f4145d1b83 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:53.366027 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-34f59714-4889-44d4-b974-85f4145d1b83 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d5c34aba8047e593b32ec34ab7fba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eefb86101fe49f9953595f91d4a790a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:53.375417 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-34f59714-4889-44d4-b974-85f4145d1b83 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] 10.222.0.69 "GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a" status: 200 len: 1358 microversion: 2.1 time: 0.163223 May 26 18:10:53.376350 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 543/1062] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:10:53 2022] GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:54.394604 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-95c94de2-2b95-417e-9c15-7e670452b62e tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:54.397050 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-95c94de2-2b95-417e-9c15-7e670452b62e tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] [instance: 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:54.404766 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-95c94de2-2b95-417e-9c15-7e670452b62e tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:54.405221 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-95c94de2-2b95-417e-9c15-7e670452b62e tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:54.406020 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-95c94de2-2b95-417e-9c15-7e670452b62e tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:54.406467 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-95c94de2-2b95-417e-9c15-7e670452b62e tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:54.552344 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-95c94de2-2b95-417e-9c15-7e670452b62e tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d5c34aba8047e593b32ec34ab7fba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eefb86101fe49f9953595f91d4a790a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:54.560505 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-95c94de2-2b95-417e-9c15-7e670452b62e tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] 10.222.0.69 "GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a" status: 200 len: 1358 microversion: 2.1 time: 0.170905 May 26 18:10:54.561096 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 520/1063] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:10:54 2022] GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:55.579202 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-b39ec1d9-f29e-4bff-98b8-685661d53f0e tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:55.580367 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-b39ec1d9-f29e-4bff-98b8-685661d53f0e tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] [instance: 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:55.587065 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b39ec1d9-f29e-4bff-98b8-685661d53f0e tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:55.587508 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b39ec1d9-f29e-4bff-98b8-685661d53f0e tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:55.588307 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b39ec1d9-f29e-4bff-98b8-685661d53f0e tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:55.588747 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b39ec1d9-f29e-4bff-98b8-685661d53f0e tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:55.724392 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-b39ec1d9-f29e-4bff-98b8-685661d53f0e tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d5c34aba8047e593b32ec34ab7fba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eefb86101fe49f9953595f91d4a790a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:55.731820 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-b39ec1d9-f29e-4bff-98b8-685661d53f0e tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] 10.222.0.69 "GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a" status: 200 len: 1358 microversion: 2.1 time: 0.156539 May 26 18:10:55.732417 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 544/1064] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:10:55 2022] GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:56.750855 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-91d2264b-2a39-443e-845b-2f40f919c1ce tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:56.753231 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-91d2264b-2a39-443e-845b-2f40f919c1ce tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] [instance: 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:56.762794 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-91d2264b-2a39-443e-845b-2f40f919c1ce tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:56.763574 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-91d2264b-2a39-443e-845b-2f40f919c1ce tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:56.765848 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-91d2264b-2a39-443e-845b-2f40f919c1ce tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:56.766072 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-91d2264b-2a39-443e-845b-2f40f919c1ce tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:56.917738 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-91d2264b-2a39-443e-845b-2f40f919c1ce tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d5c34aba8047e593b32ec34ab7fba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eefb86101fe49f9953595f91d4a790a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:56.928956 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-91d2264b-2a39-443e-845b-2f40f919c1ce tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] 10.222.0.69 "GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a" status: 200 len: 1547 microversion: 2.1 time: 0.183552 May 26 18:10:56.929548 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 521/1065] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:10:56 2022] GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a => generated 1547 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:56.948943 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-cfd58e4c-dae1-435f-b944-6f10f63f66e3 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:56.949610 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-cfd58e4c-dae1-435f-b944-6f10f63f66e3 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] [instance: 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:56.956640 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-cfd58e4c-dae1-435f-b944-6f10f63f66e3 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:56.957100 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-cfd58e4c-dae1-435f-b944-6f10f63f66e3 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:56.957982 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-cfd58e4c-dae1-435f-b944-6f10f63f66e3 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:56.958460 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-cfd58e4c-dae1-435f-b944-6f10f63f66e3 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:57.100339 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-cfd58e4c-dae1-435f-b944-6f10f63f66e3 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d5c34aba8047e593b32ec34ab7fba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eefb86101fe49f9953595f91d4a790a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:57.109460 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-cfd58e4c-dae1-435f-b944-6f10f63f66e3 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] 10.222.0.69 "GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a" status: 200 len: 1547 microversion: 2.1 time: 0.164631 May 26 18:10:57.110127 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 545/1066] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:10:56 2022] GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a => generated 1547 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:57.127804 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-ffcae9db-1624-4551-b688-828dd27cbf4a tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:57.131453 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-ffcae9db-1624-4551-b688-828dd27cbf4a tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e6d5c34aba8047e593b32ec34ab7fba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eefb86101fe49f9953595f91d4a790a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:57.132284 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-ffcae9db-1624-4551-b688-828dd27cbf4a tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Searching by: {'deleted': False, 'project_id': '5eefb86101fe49f9953595f91d4a790a'} {{(pid=117723) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 26 18:10:57.139443 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ffcae9db-1624-4551-b688-828dd27cbf4a tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:57.140104 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ffcae9db-1624-4551-b688-828dd27cbf4a tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:57.140984 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ffcae9db-1624-4551-b688-828dd27cbf4a tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:57.141424 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ffcae9db-1624-4551-b688-828dd27cbf4a tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:57.238821 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.multi_cell_list [None req-ffcae9db-1624-4551-b688-828dd27cbf4a tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117723) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 26 18:10:57.335985 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-ffcae9db-1624-4551-b688-828dd27cbf4a tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] 10.222.0.69 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.212704 May 26 18:10:57.336605 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 522/1067] 10.222.0.69 () {58 vars in 1124 bytes} [Thu May 26 18:10:57 2022] GET /compute/v2.1/servers => generated 342 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:10:57.347922 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-80835c45-c7e1-4ca1-b382-faf40834c718 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:57.348588 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-80835c45-c7e1-4ca1-b382-faf40834c718 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] [instance: 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:57.355049 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-80835c45-c7e1-4ca1-b382-faf40834c718 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:57.355495 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-80835c45-c7e1-4ca1-b382-faf40834c718 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:57.356307 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-80835c45-c7e1-4ca1-b382-faf40834c718 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:57.356754 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-80835c45-c7e1-4ca1-b382-faf40834c718 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:57.517414 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-80835c45-c7e1-4ca1-b382-faf40834c718 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d5c34aba8047e593b32ec34ab7fba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eefb86101fe49f9953595f91d4a790a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:57.525650 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-80835c45-c7e1-4ca1-b382-faf40834c718 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] 10.222.0.69 "GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a" status: 200 len: 1547 microversion: 2.1 time: 0.182609 May 26 18:10:57.526234 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 546/1068] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:10:57 2022] GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a => generated 1547 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:59.321243 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-6c4c88dd-a54f-4965-8deb-86d5cc2ded7f tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e0843336-b4ee-46ab-b3d4-15a603039780"}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:10:59.322306 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-6c4c88dd-a54f-4965-8deb-86d5cc2ded7f tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] [instance: 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:59.328926 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6c4c88dd-a54f-4965-8deb-86d5cc2ded7f tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:59.329378 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6c4c88dd-a54f-4965-8deb-86d5cc2ded7f tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:59.330329 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6c4c88dd-a54f-4965-8deb-86d5cc2ded7f tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:59.331271 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6c4c88dd-a54f-4965-8deb-86d5cc2ded7f tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:59.594941 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-6c4c88dd-a54f-4965-8deb-86d5cc2ded7f tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] 10.222.0.69 "POST /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277756 May 26 18:10:59.596092 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 523/1069] 10.222.0.69 () {60 vars in 1322 bytes} [Thu May 26 18:10:59 2022] POST /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:11:06.175244 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-027ffb77-dbb7-4afd-bcc5-ce6a6bf03e85 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:06.175864 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-027ffb77-dbb7-4afd-bcc5-ce6a6bf03e85 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] [instance: 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:06.178312 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:06.183987 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-027ffb77-dbb7-4afd-bcc5-ce6a6bf03e85 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:06.184469 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-027ffb77-dbb7-4afd-bcc5-ce6a6bf03e85 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:06.185271 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-027ffb77-dbb7-4afd-bcc5-ce6a6bf03e85 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:06.185710 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-027ffb77-dbb7-4afd-bcc5-ce6a6bf03e85 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:06.189972 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_cell1:SELECT=65 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:06.347991 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-027ffb77-dbb7-4afd-bcc5-ce6a6bf03e85 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d5c34aba8047e593b32ec34ab7fba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eefb86101fe49f9953595f91d4a790a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:06.358332 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-027ffb77-dbb7-4afd-bcc5-ce6a6bf03e85 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] 10.222.0.69 "GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a" status: 200 len: 1593 microversion: 2.1 time: 0.186965 May 26 18:11:06.358930 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 547/1070] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:11:06 2022] GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a => generated 1593 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:08.957827 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell0:SELECT=2 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:08.962928 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-94951625-f773-410e-a489-47ed800c9edc req-e47be2cc-d9cb-42a6-8511-196577486298 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a", "tag": "c59057e8-e60b-4afe-bee1-1f39250eb63e"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:11:08.967434 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:08.975222 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-94951625-f773-410e-a489-47ed800c9edc req-e47be2cc-d9cb-42a6-8511-196577486298 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:08.976108 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-94951625-f773-410e-a489-47ed800c9edc req-e47be2cc-d9cb-42a6-8511-196577486298 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:08.988397 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:08.990999 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-94951625-f773-410e-a489-47ed800c9edc req-e47be2cc-d9cb-42a6-8511-196577486298 service nova] Creating event network-changed:c59057e8-e60b-4afe-bee1-1f39250eb63e for instance 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a on hv-cinder-83607 May 26 18:11:08.999136 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-94951625-f773-410e-a489-47ed800c9edc req-e47be2cc-d9cb-42a6-8511-196577486298 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043103 May 26 18:11:09.000430 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 524/1071] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:11:10.295822 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-f6757765-2cdf-497b-aa67-9089b6894ead tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-418623073"}} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:11:10.297268 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-f6757765-2cdf-497b-aa67-9089b6894ead tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] [instance: 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:10.305097 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-f6757765-2cdf-497b-aa67-9089b6894ead tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:10.305565 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-f6757765-2cdf-497b-aa67-9089b6894ead tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:10.306441 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-f6757765-2cdf-497b-aa67-9089b6894ead tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:10.306900 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-f6757765-2cdf-497b-aa67-9089b6894ead tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:10.520692 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.network.security_group_api [None req-f6757765-2cdf-497b-aa67-9089b6894ead tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Adding security group 2bcdd3b1-90e4-455f-a9a6-f7b051a80731 to port c59057e8-e60b-4afe-bee1-1f39250eb63e May 26 18:11:10.983538 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-f6757765-2cdf-497b-aa67-9089b6894ead tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] 10.222.0.69 "POST /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a/action" status: 202 len: 0 microversion: 2.1 time: 0.695004 May 26 18:11:10.988865 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 548/1072] 10.222.0.69 () {60 vars in 1277 bytes} [Thu May 26 18:11:10 2022] POST /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a/action => generated 0 bytes in 701 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:11:10.999846 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-b5709c06-0c98-40a7-a44c-5b51e82cdd4e tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:11.004828 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-b5709c06-0c98-40a7-a44c-5b51e82cdd4e tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] [instance: 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:11.021211 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [req-49a6c22e-b358-48a8-9f13-6e575877b32f req-b7beb0f1-5061-4ec1-8cd0-a6cd103bf657 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a", "tag": "c59057e8-e60b-4afe-bee1-1f39250eb63e"}]} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:11:11.036794 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b5709c06-0c98-40a7-a44c-5b51e82cdd4e tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:11.039294 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b5709c06-0c98-40a7-a44c-5b51e82cdd4e tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:11.043594 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b5709c06-0c98-40a7-a44c-5b51e82cdd4e tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:11.044096 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b5709c06-0c98-40a7-a44c-5b51e82cdd4e tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:11.045391 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-49a6c22e-b358-48a8-9f13-6e575877b32f req-b7beb0f1-5061-4ec1-8cd0-a6cd103bf657 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:11.046026 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-49a6c22e-b358-48a8-9f13-6e575877b32f req-b7beb0f1-5061-4ec1-8cd0-a6cd103bf657 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:11.076088 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.compute.server_external_events [req-49a6c22e-b358-48a8-9f13-6e575877b32f req-b7beb0f1-5061-4ec1-8cd0-a6cd103bf657 service nova] Creating event network-changed:c59057e8-e60b-4afe-bee1-1f39250eb63e for instance 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a on hv-cinder-83607 May 26 18:11:11.086110 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [req-49a6c22e-b358-48a8-9f13-6e575877b32f req-b7beb0f1-5061-4ec1-8cd0-a6cd103bf657 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072753 May 26 18:11:11.087026 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 549/1073] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:11:11.458665 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-b5709c06-0c98-40a7-a44c-5b51e82cdd4e tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d5c34aba8047e593b32ec34ab7fba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eefb86101fe49f9953595f91d4a790a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:11.469025 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-b5709c06-0c98-40a7-a44c-5b51e82cdd4e tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] 10.222.0.69 "GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a" status: 200 len: 1757 microversion: 2.1 time: 0.475024 May 26 18:11:11.482679 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 525/1074] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:11:10 2022] GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a => generated 1757 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:13.880886 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-9a9260a5-3191-43dc-9ea9-6f949a15eccb tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2137806489", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-388820237", "security_groups": [{"name": "tempest-secgroup-smoke-714810901"}], "block_device_mapping_v2": [{"uuid": "7dc70be2-78b2-4668-8a53-fd045c81ccb6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7d5a4e77-6968-4ef2-a95a-0d27f89b0d76"}]}} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:11:14.003692 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.network.neutron [None req-9a9260a5-3191-43dc-9ea9-6f949a15eccb tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] validate_networks() for [('7d5a4e77-6968-4ef2-a95a-0d27f89b0d76', None, None, None, None, None)] {{(pid=117722) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:11:14.403165 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.virt.hardware [None req-9a9260a5-3191-43dc-9ea9-6f949a15eccb tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Flavor limits 0:0:0 {{(pid=117722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:11:14.403590 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.virt.hardware [None req-9a9260a5-3191-43dc-9ea9-6f949a15eccb tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Image limits 0:0:0 {{(pid=117722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:11:14.404112 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.virt.hardware [None req-9a9260a5-3191-43dc-9ea9-6f949a15eccb tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Flavor pref 0:0:0 {{(pid=117722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:11:14.404511 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.virt.hardware [None req-9a9260a5-3191-43dc-9ea9-6f949a15eccb tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Image pref 0:0:0 {{(pid=117722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:11:14.404927 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.virt.hardware [None req-9a9260a5-3191-43dc-9ea9-6f949a15eccb tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:11:14.415287 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-9a9260a5-3191-43dc-9ea9-6f949a15eccb tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:14.415739 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-9a9260a5-3191-43dc-9ea9-6f949a15eccb tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:14.416603 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-9a9260a5-3191-43dc-9ea9-6f949a15eccb tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:14.417046 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-9a9260a5-3191-43dc-9ea9-6f949a15eccb tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:14.446203 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.quota [None req-9a9260a5-3191-43dc-9ea9-6f949a15eccb tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Getting quotas for project ba5a75cf80284f58b9c3bed674677a39. Resources: {'instances', 'ram', 'cores'} {{(pid=117722) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:11:14.450317 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.quota [None req-9a9260a5-3191-43dc-9ea9-6f949a15eccb tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Getting quotas for user 9683ec43ae844757883a7dd5003b53d9 and project ba5a75cf80284f58b9c3bed674677a39. Resources: {'instances', 'ram', 'cores'} {{(pid=117722) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:11:14.511776 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-9a9260a5-3191-43dc-9ea9-6f949a15eccb tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Going to run 1 instances... {{(pid=117722) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:11:14.514244 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-9a9260a5-3191-43dc-9ea9-6f949a15eccb tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: 67300aac-c060-4e11-aab6-635c4a8bba9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7dc70be2-78b2-4668-8a53-fd045c81ccb6',volume_size=None,volume_type=None)] {{(pid=117722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:11:14.655250 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-9a9260a5-3191-43dc-9ea9-6f949a15eccb tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.778761 May 26 18:11:14.655909 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 550/1075] 10.222.0.69 () {60 vars in 1146 bytes} [Thu May 26 18:11:13 2022] POST /compute/v2.1/servers => generated 405 bytes in 780 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 18:11:14.666772 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-5677681b-6b07-4510-a3c3-64f32a1c59b3 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:14.667379 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-5677681b-6b07-4510-a3c3-64f32a1c59b3 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: 67300aac-c060-4e11-aab6-635c4a8bba9c] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:14.886473 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-5677681b-6b07-4510-a3c3-64f32a1c59b3 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683ec43ae844757883a7dd5003b53d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a75cf80284f58b9c3bed674677a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:14.893629 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-5677681b-6b07-4510-a3c3-64f32a1c59b3 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "GET /compute/v2.1/servers/67300aac-c060-4e11-aab6-635c4a8bba9c" status: 200 len: 1094 microversion: 2.1 time: 0.231182 May 26 18:11:14.897987 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 526/1076] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:11:14 2022] GET /compute/v2.1/servers/67300aac-c060-4e11-aab6-635c4a8bba9c => generated 1094 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:15.919079 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-f2a6566f-9ac1-4660-9f94-b11421605244 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:15.919897 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-f2a6566f-9ac1-4660-9f94-b11421605244 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: 67300aac-c060-4e11-aab6-635c4a8bba9c] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:15.928464 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-f2a6566f-9ac1-4660-9f94-b11421605244 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:15.928912 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-f2a6566f-9ac1-4660-9f94-b11421605244 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:15.929702 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-f2a6566f-9ac1-4660-9f94-b11421605244 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:15.930138 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-f2a6566f-9ac1-4660-9f94-b11421605244 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:16.069183 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-f2a6566f-9ac1-4660-9f94-b11421605244 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683ec43ae844757883a7dd5003b53d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a75cf80284f58b9c3bed674677a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:16.077700 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-f2a6566f-9ac1-4660-9f94-b11421605244 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "GET /compute/v2.1/servers/67300aac-c060-4e11-aab6-635c4a8bba9c" status: 200 len: 1210 microversion: 2.1 time: 0.162941 May 26 18:11:16.078455 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 551/1077] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:11:15 2022] GET /compute/v2.1/servers/67300aac-c060-4e11-aab6-635c4a8bba9c => generated 1210 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:17.099365 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-34440e45-e677-4363-bce6-fa5addc98edd tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:17.100668 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-34440e45-e677-4363-bce6-fa5addc98edd tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: 67300aac-c060-4e11-aab6-635c4a8bba9c] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:17.114576 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-34440e45-e677-4363-bce6-fa5addc98edd tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:17.115331 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-34440e45-e677-4363-bce6-fa5addc98edd tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:17.116606 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-34440e45-e677-4363-bce6-fa5addc98edd tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:17.117680 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-34440e45-e677-4363-bce6-fa5addc98edd tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:17.396180 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-34440e45-e677-4363-bce6-fa5addc98edd tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683ec43ae844757883a7dd5003b53d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a75cf80284f58b9c3bed674677a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:17.411193 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-34440e45-e677-4363-bce6-fa5addc98edd tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "GET /compute/v2.1/servers/67300aac-c060-4e11-aab6-635c4a8bba9c" status: 200 len: 1265 microversion: 2.1 time: 0.317593 May 26 18:11:17.421686 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 527/1078] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:11:17 2022] GET /compute/v2.1/servers/67300aac-c060-4e11-aab6-635c4a8bba9c => generated 1265 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:17.827001 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [req-5a18aadf-cc6a-4a6c-bfee-c6a0904fafaa req-89e004e5-6f1f-44e0-814d-321a60ab8299 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67300aac-c060-4e11-aab6-635c4a8bba9c", "tag": "be659ba1-8698-4fe5-9230-25e1add7adbc"}]} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:11:17.840948 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-5a18aadf-cc6a-4a6c-bfee-c6a0904fafaa req-89e004e5-6f1f-44e0-814d-321a60ab8299 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:17.841977 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-5a18aadf-cc6a-4a6c-bfee-c6a0904fafaa req-89e004e5-6f1f-44e0-814d-321a60ab8299 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:17.866786 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.compute.server_external_events [req-5a18aadf-cc6a-4a6c-bfee-c6a0904fafaa req-89e004e5-6f1f-44e0-814d-321a60ab8299 service nova] Creating event network-changed:be659ba1-8698-4fe5-9230-25e1add7adbc for instance 67300aac-c060-4e11-aab6-635c4a8bba9c on hv-cinder-83607 May 26 18:11:17.873711 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [req-5a18aadf-cc6a-4a6c-bfee-c6a0904fafaa req-89e004e5-6f1f-44e0-814d-321a60ab8299 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063161 May 26 18:11:17.876051 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 552/1079] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:11:18.430386 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-acdf9a81-273e-4c5f-b24e-edd868839b0b tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:18.431046 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-acdf9a81-273e-4c5f-b24e-edd868839b0b tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: 67300aac-c060-4e11-aab6-635c4a8bba9c] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:18.437541 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-acdf9a81-273e-4c5f-b24e-edd868839b0b tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:18.437993 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-acdf9a81-273e-4c5f-b24e-edd868839b0b tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:18.438763 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-acdf9a81-273e-4c5f-b24e-edd868839b0b tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:18.439194 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-acdf9a81-273e-4c5f-b24e-edd868839b0b tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:18.641039 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-acdf9a81-273e-4c5f-b24e-edd868839b0b tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683ec43ae844757883a7dd5003b53d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a75cf80284f58b9c3bed674677a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:18.654537 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-acdf9a81-273e-4c5f-b24e-edd868839b0b tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "GET /compute/v2.1/servers/67300aac-c060-4e11-aab6-635c4a8bba9c" status: 200 len: 1265 microversion: 2.1 time: 0.228786 May 26 18:11:18.655331 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 528/1080] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:11:18 2022] GET /compute/v2.1/servers/67300aac-c060-4e11-aab6-635c4a8bba9c => generated 1265 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:11:19.673840 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-d5055493-492c-4d3d-bcbc-4d8ab22c1497 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:19.674567 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-d5055493-492c-4d3d-bcbc-4d8ab22c1497 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: 67300aac-c060-4e11-aab6-635c4a8bba9c] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:19.682577 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d5055493-492c-4d3d-bcbc-4d8ab22c1497 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:19.683024 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d5055493-492c-4d3d-bcbc-4d8ab22c1497 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:19.683855 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d5055493-492c-4d3d-bcbc-4d8ab22c1497 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:19.684290 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-d5055493-492c-4d3d-bcbc-4d8ab22c1497 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:19.827760 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-d5055493-492c-4d3d-bcbc-4d8ab22c1497 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683ec43ae844757883a7dd5003b53d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a75cf80284f58b9c3bed674677a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:19.837050 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-d5055493-492c-4d3d-bcbc-4d8ab22c1497 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "GET /compute/v2.1/servers/67300aac-c060-4e11-aab6-635c4a8bba9c" status: 200 len: 1265 microversion: 2.1 time: 0.167818 May 26 18:11:19.837657 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 553/1081] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:11:19 2022] GET /compute/v2.1/servers/67300aac-c060-4e11-aab6-635c4a8bba9c => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:20.854655 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-11c246a8-eac1-4b7f-8362-6a65586f8366 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:20.855338 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-11c246a8-eac1-4b7f-8362-6a65586f8366 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: 67300aac-c060-4e11-aab6-635c4a8bba9c] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:20.865573 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-11c246a8-eac1-4b7f-8362-6a65586f8366 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:20.866391 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-11c246a8-eac1-4b7f-8362-6a65586f8366 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:20.868113 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-11c246a8-eac1-4b7f-8362-6a65586f8366 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:20.868946 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-11c246a8-eac1-4b7f-8362-6a65586f8366 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:21.014292 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-11c246a8-eac1-4b7f-8362-6a65586f8366 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683ec43ae844757883a7dd5003b53d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a75cf80284f58b9c3bed674677a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:21.022666 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-11c246a8-eac1-4b7f-8362-6a65586f8366 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "GET /compute/v2.1/servers/67300aac-c060-4e11-aab6-635c4a8bba9c" status: 200 len: 1265 microversion: 2.1 time: 0.171993 May 26 18:11:21.023252 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 529/1082] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:11:20 2022] GET /compute/v2.1/servers/67300aac-c060-4e11-aab6-635c4a8bba9c => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:22.041115 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-bfbd0b96-558c-4dfc-a009-46c0afd117f4 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:22.041844 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-bfbd0b96-558c-4dfc-a009-46c0afd117f4 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: 67300aac-c060-4e11-aab6-635c4a8bba9c] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:22.048558 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-bfbd0b96-558c-4dfc-a009-46c0afd117f4 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:22.049004 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-bfbd0b96-558c-4dfc-a009-46c0afd117f4 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:22.049782 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-bfbd0b96-558c-4dfc-a009-46c0afd117f4 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:22.050217 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-bfbd0b96-558c-4dfc-a009-46c0afd117f4 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:22.210314 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-bfbd0b96-558c-4dfc-a009-46c0afd117f4 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683ec43ae844757883a7dd5003b53d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a75cf80284f58b9c3bed674677a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:22.218455 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-bfbd0b96-558c-4dfc-a009-46c0afd117f4 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "GET /compute/v2.1/servers/67300aac-c060-4e11-aab6-635c4a8bba9c" status: 200 len: 1265 microversion: 2.1 time: 0.181102 May 26 18:11:22.219052 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 554/1083] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:11:22 2022] GET /compute/v2.1/servers/67300aac-c060-4e11-aab6-635c4a8bba9c => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:23.236145 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-6fcaa995-71a0-4ae8-8623-da2a7d94a266 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:23.236757 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-6fcaa995-71a0-4ae8-8623-da2a7d94a266 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: 67300aac-c060-4e11-aab6-635c4a8bba9c] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:23.243504 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6fcaa995-71a0-4ae8-8623-da2a7d94a266 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:23.243945 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6fcaa995-71a0-4ae8-8623-da2a7d94a266 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:23.244957 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6fcaa995-71a0-4ae8-8623-da2a7d94a266 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:23.245397 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6fcaa995-71a0-4ae8-8623-da2a7d94a266 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:23.422847 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-6fcaa995-71a0-4ae8-8623-da2a7d94a266 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683ec43ae844757883a7dd5003b53d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a75cf80284f58b9c3bed674677a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:23.430855 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-6fcaa995-71a0-4ae8-8623-da2a7d94a266 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "GET /compute/v2.1/servers/67300aac-c060-4e11-aab6-635c4a8bba9c" status: 200 len: 1265 microversion: 2.1 time: 0.198641 May 26 18:11:23.431436 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 530/1084] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:11:23 2022] GET /compute/v2.1/servers/67300aac-c060-4e11-aab6-635c4a8bba9c => generated 1265 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:24.448575 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-65dd7ff7-0e70-4b7c-832d-0ba1847a3e77 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:24.449204 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-65dd7ff7-0e70-4b7c-832d-0ba1847a3e77 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: 67300aac-c060-4e11-aab6-635c4a8bba9c] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:24.451866 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_cell0:SELECT=2 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:24.457499 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_cell0:SELECT=6 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:24.460254 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-65dd7ff7-0e70-4b7c-832d-0ba1847a3e77 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:24.460710 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-65dd7ff7-0e70-4b7c-832d-0ba1847a3e77 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:24.461646 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-65dd7ff7-0e70-4b7c-832d-0ba1847a3e77 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:24.462086 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-65dd7ff7-0e70-4b7c-832d-0ba1847a3e77 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:24.623475 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-65dd7ff7-0e70-4b7c-832d-0ba1847a3e77 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683ec43ae844757883a7dd5003b53d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a75cf80284f58b9c3bed674677a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:24.631502 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-65dd7ff7-0e70-4b7c-832d-0ba1847a3e77 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "GET /compute/v2.1/servers/67300aac-c060-4e11-aab6-635c4a8bba9c" status: 200 len: 1265 microversion: 2.1 time: 0.186892 May 26 18:11:24.632116 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 555/1085] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:11:24 2022] GET /compute/v2.1/servers/67300aac-c060-4e11-aab6-635c4a8bba9c => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:25.648680 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-6ff42662-35da-4e58-853e-0d6db5bb56c3 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:25.650259 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-6ff42662-35da-4e58-853e-0d6db5bb56c3 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: 67300aac-c060-4e11-aab6-635c4a8bba9c] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:25.652737 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell0:SELECT=2 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:25.658931 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6ff42662-35da-4e58-853e-0d6db5bb56c3 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:25.659469 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6ff42662-35da-4e58-853e-0d6db5bb56c3 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:25.660368 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6ff42662-35da-4e58-853e-0d6db5bb56c3 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:25.660990 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6ff42662-35da-4e58-853e-0d6db5bb56c3 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:25.814990 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-6ff42662-35da-4e58-853e-0d6db5bb56c3 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683ec43ae844757883a7dd5003b53d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a75cf80284f58b9c3bed674677a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:25.824058 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-6ff42662-35da-4e58-853e-0d6db5bb56c3 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "GET /compute/v2.1/servers/67300aac-c060-4e11-aab6-635c4a8bba9c" status: 200 len: 1265 microversion: 2.1 time: 0.179277 May 26 18:11:25.824658 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 531/1086] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:11:25 2022] GET /compute/v2.1/servers/67300aac-c060-4e11-aab6-635c4a8bba9c => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:26.594217 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [req-627cd2db-c542-4f90-a7c5-1fadd5b9d06e req-442c9ae7-4235-4a32-a55f-ae804969b6b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67300aac-c060-4e11-aab6-635c4a8bba9c", "name": "network-vif-plugged", "status": "completed", "tag": "be659ba1-8698-4fe5-9230-25e1add7adbc"}]} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:11:26.604885 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-627cd2db-c542-4f90-a7c5-1fadd5b9d06e req-442c9ae7-4235-4a32-a55f-ae804969b6b8 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:26.605697 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-627cd2db-c542-4f90-a7c5-1fadd5b9d06e req-442c9ae7-4235-4a32-a55f-ae804969b6b8 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:26.619343 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.compute.server_external_events [req-627cd2db-c542-4f90-a7c5-1fadd5b9d06e req-442c9ae7-4235-4a32-a55f-ae804969b6b8 service nova] Creating event network-vif-plugged:be659ba1-8698-4fe5-9230-25e1add7adbc for instance 67300aac-c060-4e11-aab6-635c4a8bba9c on hv-cinder-83607 May 26 18:11:26.625274 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [req-627cd2db-c542-4f90-a7c5-1fadd5b9d06e req-442c9ae7-4235-4a32-a55f-ae804969b6b8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034589 May 26 18:11:26.625835 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 556/1087] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:11:26.841721 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-9d2f78aa-5447-49a7-9b2c-f934b8158cd5 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:26.842564 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-9d2f78aa-5447-49a7-9b2c-f934b8158cd5 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: 67300aac-c060-4e11-aab6-635c4a8bba9c] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:26.849604 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9d2f78aa-5447-49a7-9b2c-f934b8158cd5 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:26.850058 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9d2f78aa-5447-49a7-9b2c-f934b8158cd5 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:26.850872 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9d2f78aa-5447-49a7-9b2c-f934b8158cd5 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:26.851312 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9d2f78aa-5447-49a7-9b2c-f934b8158cd5 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:27.029148 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-9d2f78aa-5447-49a7-9b2c-f934b8158cd5 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683ec43ae844757883a7dd5003b53d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a75cf80284f58b9c3bed674677a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:27.036785 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-9d2f78aa-5447-49a7-9b2c-f934b8158cd5 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "GET /compute/v2.1/servers/67300aac-c060-4e11-aab6-635c4a8bba9c" status: 200 len: 1265 microversion: 2.1 time: 0.199018 May 26 18:11:27.037384 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 532/1088] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:11:26 2022] GET /compute/v2.1/servers/67300aac-c060-4e11-aab6-635c4a8bba9c => generated 1265 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:28.056901 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-a57f098d-3752-43d6-b80d-bfecad6eefca tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:28.057638 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-a57f098d-3752-43d6-b80d-bfecad6eefca tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: 67300aac-c060-4e11-aab6-635c4a8bba9c] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:28.065031 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-a57f098d-3752-43d6-b80d-bfecad6eefca tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:28.065490 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-a57f098d-3752-43d6-b80d-bfecad6eefca tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:28.067319 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-a57f098d-3752-43d6-b80d-bfecad6eefca tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:28.067957 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-a57f098d-3752-43d6-b80d-bfecad6eefca tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:28.218628 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-a57f098d-3752-43d6-b80d-bfecad6eefca tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683ec43ae844757883a7dd5003b53d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a75cf80284f58b9c3bed674677a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:28.226380 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-a57f098d-3752-43d6-b80d-bfecad6eefca tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "GET /compute/v2.1/servers/67300aac-c060-4e11-aab6-635c4a8bba9c" status: 200 len: 1452 microversion: 2.1 time: 0.175797 May 26 18:11:28.226969 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 557/1089] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:11:28 2022] GET /compute/v2.1/servers/67300aac-c060-4e11-aab6-635c4a8bba9c => generated 1452 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:28.242698 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-39964cc0-3349-45f0-81b0-a8faf8298e46 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:28.243562 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-39964cc0-3349-45f0-81b0-a8faf8298e46 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: 67300aac-c060-4e11-aab6-635c4a8bba9c] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:28.250358 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-39964cc0-3349-45f0-81b0-a8faf8298e46 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:28.250859 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-39964cc0-3349-45f0-81b0-a8faf8298e46 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:28.251678 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-39964cc0-3349-45f0-81b0-a8faf8298e46 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:28.252162 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-39964cc0-3349-45f0-81b0-a8faf8298e46 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:28.392712 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-39964cc0-3349-45f0-81b0-a8faf8298e46 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683ec43ae844757883a7dd5003b53d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a75cf80284f58b9c3bed674677a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:28.401059 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-39964cc0-3349-45f0-81b0-a8faf8298e46 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "GET /compute/v2.1/servers/67300aac-c060-4e11-aab6-635c4a8bba9c" status: 200 len: 1452 microversion: 2.1 time: 0.162689 May 26 18:11:28.401646 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 533/1090] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:11:28 2022] GET /compute/v2.1/servers/67300aac-c060-4e11-aab6-635c4a8bba9c => generated 1452 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:30.461863 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [req-ad99a092-d7e2-4982-a872-d2aaaea1cad0 req-9577b5de-cdc0-46a8-8398-21699b4f6f2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67300aac-c060-4e11-aab6-635c4a8bba9c", "tag": "be659ba1-8698-4fe5-9230-25e1add7adbc"}]} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:11:30.470999 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-ad99a092-d7e2-4982-a872-d2aaaea1cad0 req-9577b5de-cdc0-46a8-8398-21699b4f6f2b service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:30.470999 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-ad99a092-d7e2-4982-a872-d2aaaea1cad0 req-9577b5de-cdc0-46a8-8398-21699b4f6f2b service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:30.483473 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.compute.server_external_events [req-ad99a092-d7e2-4982-a872-d2aaaea1cad0 req-9577b5de-cdc0-46a8-8398-21699b4f6f2b service nova] Creating event network-changed:be659ba1-8698-4fe5-9230-25e1add7adbc for instance 67300aac-c060-4e11-aab6-635c4a8bba9c on hv-cinder-83607 May 26 18:11:30.489456 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [req-ad99a092-d7e2-4982-a872-d2aaaea1cad0 req-9577b5de-cdc0-46a8-8398-21699b4f6f2b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030930 May 26 18:11:30.490068 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 558/1091] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:11:33.800254 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-90174b1e-50b3-4e56-a132-ecdc4882d476 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:11:33.801372 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-90174b1e-50b3-4e56-a132-ecdc4882d476 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] [instance: 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:33.808247 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-90174b1e-50b3-4e56-a132-ecdc4882d476 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:33.808700 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-90174b1e-50b3-4e56-a132-ecdc4882d476 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:33.809508 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-90174b1e-50b3-4e56-a132-ecdc4882d476 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:33.809940 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-90174b1e-50b3-4e56-a132-ecdc4882d476 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:33.879792 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-90174b1e-50b3-4e56-a132-ecdc4882d476 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] 10.222.0.69 "POST /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a/action" status: 202 len: 0 microversion: 2.1 time: 0.083406 May 26 18:11:33.880472 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 534/1092] 10.222.0.69 () {60 vars in 1277 bytes} [Thu May 26 18:11:33 2022] POST /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:11:33.890106 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-e68d4e29-2287-48a5-bdb3-b12d54563e85 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:33.890872 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-e68d4e29-2287-48a5-bdb3-b12d54563e85 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] [instance: 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:33.898125 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e68d4e29-2287-48a5-bdb3-b12d54563e85 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:33.898581 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e68d4e29-2287-48a5-bdb3-b12d54563e85 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:33.899370 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e68d4e29-2287-48a5-bdb3-b12d54563e85 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:33.899814 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e68d4e29-2287-48a5-bdb3-b12d54563e85 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:34.052112 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-e68d4e29-2287-48a5-bdb3-b12d54563e85 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d5c34aba8047e593b32ec34ab7fba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eefb86101fe49f9953595f91d4a790a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:34.061779 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-e68d4e29-2287-48a5-bdb3-b12d54563e85 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] 10.222.0.69 "GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a" status: 200 len: 1749 microversion: 2.1 time: 0.176264 May 26 18:11:34.062361 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 559/1093] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:11:33 2022] GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a => generated 1749 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:35.080548 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-caec1558-a2aa-4ea5-89c5-37cb84338f7c tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:35.081166 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-caec1558-a2aa-4ea5-89c5-37cb84338f7c tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] [instance: 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:35.088178 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-caec1558-a2aa-4ea5-89c5-37cb84338f7c tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:35.088644 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-caec1558-a2aa-4ea5-89c5-37cb84338f7c tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:35.089447 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-caec1558-a2aa-4ea5-89c5-37cb84338f7c tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:35.089890 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-caec1558-a2aa-4ea5-89c5-37cb84338f7c tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:35.235209 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-caec1558-a2aa-4ea5-89c5-37cb84338f7c tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d5c34aba8047e593b32ec34ab7fba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eefb86101fe49f9953595f91d4a790a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:35.244598 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-caec1558-a2aa-4ea5-89c5-37cb84338f7c tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] 10.222.0.69 "GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a" status: 200 len: 1754 microversion: 2.1 time: 0.168885 May 26 18:11:35.245169 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 535/1094] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:11:35 2022] GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:36.262789 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-31539c82-6b75-4f5a-a1da-1f5fb8fb6fd5 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:36.263406 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-31539c82-6b75-4f5a-a1da-1f5fb8fb6fd5 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] [instance: 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:36.266010 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:36.272119 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-31539c82-6b75-4f5a-a1da-1f5fb8fb6fd5 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:36.272574 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-31539c82-6b75-4f5a-a1da-1f5fb8fb6fd5 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:36.273341 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-31539c82-6b75-4f5a-a1da-1f5fb8fb6fd5 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:36.273781 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-31539c82-6b75-4f5a-a1da-1f5fb8fb6fd5 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:36.278676 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_cell1:SELECT=56 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:36.420185 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-31539c82-6b75-4f5a-a1da-1f5fb8fb6fd5 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d5c34aba8047e593b32ec34ab7fba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eefb86101fe49f9953595f91d4a790a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:36.428227 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-31539c82-6b75-4f5a-a1da-1f5fb8fb6fd5 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] 10.222.0.69 "GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a" status: 200 len: 1754 microversion: 2.1 time: 0.169284 May 26 18:11:36.428797 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 560/1095] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:11:36 2022] GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:37.445500 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-2d917486-8850-4699-a7b3-1d2dd62f688e tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:37.446141 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-2d917486-8850-4699-a7b3-1d2dd62f688e tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] [instance: 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:37.452807 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2d917486-8850-4699-a7b3-1d2dd62f688e tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:37.453257 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2d917486-8850-4699-a7b3-1d2dd62f688e tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:37.454034 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2d917486-8850-4699-a7b3-1d2dd62f688e tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:37.454471 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2d917486-8850-4699-a7b3-1d2dd62f688e tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:37.606238 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-2d917486-8850-4699-a7b3-1d2dd62f688e tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d5c34aba8047e593b32ec34ab7fba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eefb86101fe49f9953595f91d4a790a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:37.614858 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-2d917486-8850-4699-a7b3-1d2dd62f688e tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] 10.222.0.69 "GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a" status: 200 len: 1754 microversion: 2.1 time: 0.172577 May 26 18:11:37.615496 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 536/1096] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:11:37 2022] GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a => generated 1754 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:11:38.634119 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-882d559b-3524-4a66-88af-b13f01aa48d2 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:38.634726 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-882d559b-3524-4a66-88af-b13f01aa48d2 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] [instance: 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:38.641300 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-882d559b-3524-4a66-88af-b13f01aa48d2 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:38.641743 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-882d559b-3524-4a66-88af-b13f01aa48d2 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:38.642506 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-882d559b-3524-4a66-88af-b13f01aa48d2 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:38.642938 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-882d559b-3524-4a66-88af-b13f01aa48d2 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:38.790238 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-882d559b-3524-4a66-88af-b13f01aa48d2 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d5c34aba8047e593b32ec34ab7fba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eefb86101fe49f9953595f91d4a790a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:38.798221 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-882d559b-3524-4a66-88af-b13f01aa48d2 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] 10.222.0.69 "GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a" status: 200 len: 1754 microversion: 2.1 time: 0.169013 May 26 18:11:38.798795 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 561/1097] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:11:38 2022] GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:39.816123 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-5f7d64c7-fbe2-4afc-8261-099d9c16bca5 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:39.816779 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-5f7d64c7-fbe2-4afc-8261-099d9c16bca5 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] [instance: 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:39.823447 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5f7d64c7-fbe2-4afc-8261-099d9c16bca5 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:39.823941 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5f7d64c7-fbe2-4afc-8261-099d9c16bca5 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:39.824743 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5f7d64c7-fbe2-4afc-8261-099d9c16bca5 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:39.825222 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5f7d64c7-fbe2-4afc-8261-099d9c16bca5 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:39.976792 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-5f7d64c7-fbe2-4afc-8261-099d9c16bca5 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d5c34aba8047e593b32ec34ab7fba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eefb86101fe49f9953595f91d4a790a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:39.984832 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-5f7d64c7-fbe2-4afc-8261-099d9c16bca5 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] 10.222.0.69 "GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a" status: 200 len: 1754 microversion: 2.1 time: 0.172696 May 26 18:11:39.985398 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 537/1098] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:11:39 2022] GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a => generated 1754 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:41.004240 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-b7e4b404-ec21-4858-bc6c-7c0fa365aec9 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:41.005424 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-b7e4b404-ec21-4858-bc6c-7c0fa365aec9 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] [instance: 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:41.012503 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b7e4b404-ec21-4858-bc6c-7c0fa365aec9 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:41.012950 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b7e4b404-ec21-4858-bc6c-7c0fa365aec9 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:41.013723 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b7e4b404-ec21-4858-bc6c-7c0fa365aec9 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:41.014160 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b7e4b404-ec21-4858-bc6c-7c0fa365aec9 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:41.165715 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-b7e4b404-ec21-4858-bc6c-7c0fa365aec9 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d5c34aba8047e593b32ec34ab7fba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eefb86101fe49f9953595f91d4a790a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:41.174039 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-b7e4b404-ec21-4858-bc6c-7c0fa365aec9 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] 10.222.0.69 "GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a" status: 200 len: 1754 microversion: 2.1 time: 0.173669 May 26 18:11:41.174618 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 562/1099] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:11:40 2022] GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a => generated 1754 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:42.192588 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-469feab0-f879-47b2-9b69-d5c371c6887b tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:42.193354 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-469feab0-f879-47b2-9b69-d5c371c6887b tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] [instance: 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:42.195459 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_api:SELECT=30 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:42.201049 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-469feab0-f879-47b2-9b69-d5c371c6887b tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:42.201506 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-469feab0-f879-47b2-9b69-d5c371c6887b tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:42.202291 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-469feab0-f879-47b2-9b69-d5c371c6887b tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:42.202738 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-469feab0-f879-47b2-9b69-d5c371c6887b tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:42.205608 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:42.357686 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-469feab0-f879-47b2-9b69-d5c371c6887b tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d5c34aba8047e593b32ec34ab7fba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eefb86101fe49f9953595f91d4a790a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:42.365799 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-469feab0-f879-47b2-9b69-d5c371c6887b tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] 10.222.0.69 "GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a" status: 200 len: 1754 microversion: 2.1 time: 0.177414 May 26 18:11:42.366474 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 538/1100] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:11:42 2022] GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a => generated 1754 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:43.383353 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-3506fbb9-b0f2-44f4-8590-b2ec51a557df tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:43.383959 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-3506fbb9-b0f2-44f4-8590-b2ec51a557df tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] [instance: 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:43.390874 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3506fbb9-b0f2-44f4-8590-b2ec51a557df tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:43.391332 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3506fbb9-b0f2-44f4-8590-b2ec51a557df tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:43.392151 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3506fbb9-b0f2-44f4-8590-b2ec51a557df tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:43.392593 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3506fbb9-b0f2-44f4-8590-b2ec51a557df tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:43.482585 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 18:11:43.483181 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Thu May 26 18:11:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 18:11:43.548553 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-3506fbb9-b0f2-44f4-8590-b2ec51a557df tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d5c34aba8047e593b32ec34ab7fba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eefb86101fe49f9953595f91d4a790a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:43.557674 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-3506fbb9-b0f2-44f4-8590-b2ec51a557df tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] 10.222.0.69 "GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a" status: 200 len: 1754 microversion: 2.1 time: 0.178689 May 26 18:11:43.558276 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 563/1101] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:11:43 2022] GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a => generated 1754 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:44.575393 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-c8490af5-8d91-4792-a41a-3a88d887dcc5 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:44.576033 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-c8490af5-8d91-4792-a41a-3a88d887dcc5 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] [instance: 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:44.582697 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c8490af5-8d91-4792-a41a-3a88d887dcc5 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:44.583172 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c8490af5-8d91-4792-a41a-3a88d887dcc5 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:44.584053 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c8490af5-8d91-4792-a41a-3a88d887dcc5 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:44.584500 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c8490af5-8d91-4792-a41a-3a88d887dcc5 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:44.736047 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-c8490af5-8d91-4792-a41a-3a88d887dcc5 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d5c34aba8047e593b32ec34ab7fba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eefb86101fe49f9953595f91d4a790a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:44.745437 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-c8490af5-8d91-4792-a41a-3a88d887dcc5 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] 10.222.0.69 "GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a" status: 200 len: 1754 microversion: 2.1 time: 0.174090 May 26 18:11:44.746008 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 539/1102] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:11:44 2022] GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a => generated 1754 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:45.763019 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-b13d82b1-573d-47c3-af43-c201348fbc75 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:45.763762 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-b13d82b1-573d-47c3-af43-c201348fbc75 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] [instance: 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:45.770647 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b13d82b1-573d-47c3-af43-c201348fbc75 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:45.772260 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b13d82b1-573d-47c3-af43-c201348fbc75 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:45.773039 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b13d82b1-573d-47c3-af43-c201348fbc75 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:45.773524 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-b13d82b1-573d-47c3-af43-c201348fbc75 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:45.930022 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-b13d82b1-573d-47c3-af43-c201348fbc75 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d5c34aba8047e593b32ec34ab7fba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eefb86101fe49f9953595f91d4a790a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:45.938760 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-b13d82b1-573d-47c3-af43-c201348fbc75 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] 10.222.0.69 "GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a" status: 200 len: 1754 microversion: 2.1 time: 0.179565 May 26 18:11:45.939356 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 564/1103] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:11:45 2022] GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a => generated 1754 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:46.956783 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-a7c341b1-3e1b-4f56-8ecf-ac0f5202d823 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:46.957449 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-a7c341b1-3e1b-4f56-8ecf-ac0f5202d823 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] [instance: 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:46.964389 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a7c341b1-3e1b-4f56-8ecf-ac0f5202d823 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:46.964856 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a7c341b1-3e1b-4f56-8ecf-ac0f5202d823 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:46.965665 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a7c341b1-3e1b-4f56-8ecf-ac0f5202d823 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:46.966115 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a7c341b1-3e1b-4f56-8ecf-ac0f5202d823 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:47.123606 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-a7c341b1-3e1b-4f56-8ecf-ac0f5202d823 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d5c34aba8047e593b32ec34ab7fba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eefb86101fe49f9953595f91d4a790a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:47.132512 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-a7c341b1-3e1b-4f56-8ecf-ac0f5202d823 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] 10.222.0.69 "GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a" status: 200 len: 1754 microversion: 2.1 time: 0.179535 May 26 18:11:47.133109 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 540/1104] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:11:46 2022] GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a => generated 1754 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:48.149401 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-c46a8cb8-39ed-43c0-8826-b8df6b84029a tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:48.150011 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-c46a8cb8-39ed-43c0-8826-b8df6b84029a tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] [instance: 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:48.156970 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c46a8cb8-39ed-43c0-8826-b8df6b84029a tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:48.157490 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c46a8cb8-39ed-43c0-8826-b8df6b84029a tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:48.158269 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c46a8cb8-39ed-43c0-8826-b8df6b84029a tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:48.158712 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c46a8cb8-39ed-43c0-8826-b8df6b84029a tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:48.315268 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-c46a8cb8-39ed-43c0-8826-b8df6b84029a tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d5c34aba8047e593b32ec34ab7fba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eefb86101fe49f9953595f91d4a790a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:48.325900 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-c46a8cb8-39ed-43c0-8826-b8df6b84029a tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] 10.222.0.69 "GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a" status: 200 len: 1754 microversion: 2.1 time: 0.180295 May 26 18:11:48.326914 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 565/1105] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:11:48 2022] GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a => generated 1754 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:11:49.348857 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-b28dbad2-8ef9-460d-bf22-05922c20443f tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:49.349698 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-b28dbad2-8ef9-460d-bf22-05922c20443f tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] [instance: 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:49.363273 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b28dbad2-8ef9-460d-bf22-05922c20443f tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:49.363723 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b28dbad2-8ef9-460d-bf22-05922c20443f tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:49.364537 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b28dbad2-8ef9-460d-bf22-05922c20443f tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:49.364975 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b28dbad2-8ef9-460d-bf22-05922c20443f tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:49.512824 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-b28dbad2-8ef9-460d-bf22-05922c20443f tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d5c34aba8047e593b32ec34ab7fba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eefb86101fe49f9953595f91d4a790a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:49.520792 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-b28dbad2-8ef9-460d-bf22-05922c20443f tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] 10.222.0.69 "GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a" status: 200 len: 1754 microversion: 2.1 time: 0.176621 May 26 18:11:49.521392 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 541/1106] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:11:49 2022] GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a => generated 1754 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:50.539580 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-5ef692be-2794-4968-8f54-a415d8c7ff5c tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:50.540227 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-5ef692be-2794-4968-8f54-a415d8c7ff5c tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] [instance: 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:50.546957 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-5ef692be-2794-4968-8f54-a415d8c7ff5c tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:50.547396 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-5ef692be-2794-4968-8f54-a415d8c7ff5c tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:50.548190 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-5ef692be-2794-4968-8f54-a415d8c7ff5c tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:50.548623 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-5ef692be-2794-4968-8f54-a415d8c7ff5c tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:50.706115 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-5ef692be-2794-4968-8f54-a415d8c7ff5c tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d5c34aba8047e593b32ec34ab7fba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eefb86101fe49f9953595f91d4a790a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:50.715537 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-5ef692be-2794-4968-8f54-a415d8c7ff5c tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] 10.222.0.69 "GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a" status: 200 len: 1754 microversion: 2.1 time: 0.179569 May 26 18:11:50.715537 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 566/1107] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:11:50 2022] GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a => generated 1754 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:51.732987 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-143b909c-ed7e-456b-97ef-e54565b3fab8 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:51.733601 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-143b909c-ed7e-456b-97ef-e54565b3fab8 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] [instance: 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:51.740922 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-143b909c-ed7e-456b-97ef-e54565b3fab8 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:51.741375 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-143b909c-ed7e-456b-97ef-e54565b3fab8 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:51.742161 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-143b909c-ed7e-456b-97ef-e54565b3fab8 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:51.742595 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-143b909c-ed7e-456b-97ef-e54565b3fab8 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:51.898794 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-143b909c-ed7e-456b-97ef-e54565b3fab8 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d5c34aba8047e593b32ec34ab7fba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eefb86101fe49f9953595f91d4a790a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:51.907223 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-143b909c-ed7e-456b-97ef-e54565b3fab8 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] 10.222.0.69 "GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a" status: 200 len: 1757 microversion: 2.1 time: 0.178790 May 26 18:11:51.907792 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 542/1108] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:11:51 2022] GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:12:25.094395 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-3539e379-9fad-4566-95e2-7e42e559ce64 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-418623073"}} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:12:25.095378 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-3539e379-9fad-4566-95e2-7e42e559ce64 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] [instance: 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:25.097524 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_api:SELECT=13 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:25.098226 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_cell1:SELECT=41 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:25.105581 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3539e379-9fad-4566-95e2-7e42e559ce64 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:25.106034 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3539e379-9fad-4566-95e2-7e42e559ce64 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:25.106837 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3539e379-9fad-4566-95e2-7e42e559ce64 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:25.107281 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-3539e379-9fad-4566-95e2-7e42e559ce64 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:25.285074 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.network.security_group_api [None req-3539e379-9fad-4566-95e2-7e42e559ce64 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Removing security group 2bcdd3b1-90e4-455f-a9a6-f7b051a80731 from port c59057e8-e60b-4afe-bee1-1f39250eb63e May 26 18:12:25.785862 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-3539e379-9fad-4566-95e2-7e42e559ce64 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] 10.222.0.69 "POST /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a/action" status: 202 len: 0 microversion: 2.1 time: 0.695469 May 26 18:12:25.795125 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 567/1109] 10.222.0.69 () {60 vars in 1277 bytes} [Thu May 26 18:12:25 2022] POST /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a/action => generated 0 bytes in 698 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:12:25.827985 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_api:SELECT=9 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:25.832242 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=29 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:25.975144 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-a5f68030-99cb-4d3e-b486-ea9f942fff0d req-30316d62-0020-4c20-9cf2-eb76c0e968c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a", "tag": "c59057e8-e60b-4afe-bee1-1f39250eb63e"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:12:26.001855 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-a5f68030-99cb-4d3e-b486-ea9f942fff0d req-30316d62-0020-4c20-9cf2-eb76c0e968c3 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:26.002807 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-a5f68030-99cb-4d3e-b486-ea9f942fff0d req-30316d62-0020-4c20-9cf2-eb76c0e968c3 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:26.022837 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-a5f68030-99cb-4d3e-b486-ea9f942fff0d req-30316d62-0020-4c20-9cf2-eb76c0e968c3 service nova] Creating event network-changed:c59057e8-e60b-4afe-bee1-1f39250eb63e for instance 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a on hv-cinder-83607 May 26 18:12:26.030011 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-a5f68030-99cb-4d3e-b486-ea9f942fff0d req-30316d62-0020-4c20-9cf2-eb76c0e968c3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.236603 May 26 18:12:26.030963 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 543/1110] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:12:27.130131 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-67ef3998-f739-4d88-876c-0c03fd1fd38c tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:27.131078 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-67ef3998-f739-4d88-876c-0c03fd1fd38c tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] [instance: 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:27.141222 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-67ef3998-f739-4d88-876c-0c03fd1fd38c tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:27.142061 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-67ef3998-f739-4d88-876c-0c03fd1fd38c tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:27.143470 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-67ef3998-f739-4d88-876c-0c03fd1fd38c tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:27.144351 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-67ef3998-f739-4d88-876c-0c03fd1fd38c tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:27.286905 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.objects.instance [None req-67ef3998-f739-4d88-876c-0c03fd1fd38c tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lazy-loading 'services' on Instance uuid 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a {{(pid=117722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:12:27.375365 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-67ef3998-f739-4d88-876c-0c03fd1fd38c tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] 10.222.0.69 "DELETE /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a/os-volume_attachments/e0843336-b4ee-46ab-b3d4-15a603039780" status: 202 len: 0 microversion: 2.1 time: 0.250587 May 26 18:12:27.376713 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 568/1111] 10.222.0.69 () {58 vars in 1415 bytes} [Thu May 26 18:12:27 2022] DELETE /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a/os-volume_attachments/e0843336-b4ee-46ab-b3d4-15a603039780 => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:12:27.388069 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-1ca316f3-891a-41ff-95c7-f002f1f37278 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:27.390196 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-1ca316f3-891a-41ff-95c7-f002f1f37278 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] [instance: 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:27.402094 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1ca316f3-891a-41ff-95c7-f002f1f37278 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:27.403038 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1ca316f3-891a-41ff-95c7-f002f1f37278 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:27.405027 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1ca316f3-891a-41ff-95c7-f002f1f37278 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:27.405876 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1ca316f3-891a-41ff-95c7-f002f1f37278 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:27.456695 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-1ca316f3-891a-41ff-95c7-f002f1f37278 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] 10.222.0.69 "GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074162 May 26 18:12:27.457280 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 544/1112] 10.222.0.69 () {58 vars in 1301 bytes} [Thu May 26 18:12:27 2022] GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:12:28.048870 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [req-8faa7da9-8cb5-4442-8c7a-2231f9dfebb2 req-07bd4a68-9240-4729-af8f-efd2efbd508d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a", "tag": "c59057e8-e60b-4afe-bee1-1f39250eb63e"}]} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:12:28.062403 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-8faa7da9-8cb5-4442-8c7a-2231f9dfebb2 req-07bd4a68-9240-4729-af8f-efd2efbd508d service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:28.063211 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-8faa7da9-8cb5-4442-8c7a-2231f9dfebb2 req-07bd4a68-9240-4729-af8f-efd2efbd508d service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:28.084801 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.compute.server_external_events [req-8faa7da9-8cb5-4442-8c7a-2231f9dfebb2 req-07bd4a68-9240-4729-af8f-efd2efbd508d service nova] Creating event network-changed:c59057e8-e60b-4afe-bee1-1f39250eb63e for instance 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a on hv-cinder-83607 May 26 18:12:28.094157 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [req-8faa7da9-8cb5-4442-8c7a-2231f9dfebb2 req-07bd4a68-9240-4729-af8f-efd2efbd508d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049227 May 26 18:12:28.095278 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 569/1113] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:12:28.474329 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-55125d58-0880-421b-9922-86341934d6a5 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:28.475875 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-55125d58-0880-421b-9922-86341934d6a5 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] [instance: 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:28.487299 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-55125d58-0880-421b-9922-86341934d6a5 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:28.488404 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-55125d58-0880-421b-9922-86341934d6a5 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:28.489747 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-55125d58-0880-421b-9922-86341934d6a5 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:28.490357 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-55125d58-0880-421b-9922-86341934d6a5 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:28.535960 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-55125d58-0880-421b-9922-86341934d6a5 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] 10.222.0.69 "GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.068609 May 26 18:12:28.536931 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 545/1114] 10.222.0.69 () {58 vars in 1301 bytes} [Thu May 26 18:12:28 2022] GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 18:12:28.557362 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-a82d4909-62c7-40d2-aac5-17bb7f7215fd tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:28.558254 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-a82d4909-62c7-40d2-aac5-17bb7f7215fd tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] [instance: 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:28.572350 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-a82d4909-62c7-40d2-aac5-17bb7f7215fd tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:28.573968 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-a82d4909-62c7-40d2-aac5-17bb7f7215fd tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:28.576096 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-a82d4909-62c7-40d2-aac5-17bb7f7215fd tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:28.577127 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-a82d4909-62c7-40d2-aac5-17bb7f7215fd tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:28.705408 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.wsgi [None req-a82d4909-62c7-40d2-aac5-17bb7f7215fd tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] HTTP exception thrown: Instance 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a is not attached to volume e0843336-b4ee-46ab-b3d4-15a603039780 May 26 18:12:28.708051 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-a82d4909-62c7-40d2-aac5-17bb7f7215fd tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Request method failure captured: May 26 18:12:28.708051 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: request: DELETE /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a/os-volume_attachments/e0843336-b4ee-46ab-b3d4-15a603039780 HTTP/1.1 May 26 18:12:28.708051 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Accept: application/json May 26 18:12:28.708051 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Accept-Encoding: identity May 26 18:12:28.708051 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Connection: close May 26 18:12:28.708051 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Content-Length: 0 May 26 18:12:28.708051 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Content-Type: application/json May 26 18:12:28.708051 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Host: 10.222.0.69 May 26 18:12:28.708051 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Openstack-System-Scope: None May 26 18:12:28.708051 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: User-Agent: python-urllib3/1.26.9 May 26 18:12:28.708051 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Auth-Token: gAAAAABij8KGN3Z-vdbfP_lSh9zLh63JbjAFdVqDydYnP9QKW4XT4Tpa5SjqYRR1wQkP2RcwjUs-YHhFUlRoewjDmW12gfeRHkgNqOTtxGJlZJVT2riLNTbN7hxdBUtboQUnLTpQ8WexXqpcEadOjHKqWyE4QQKsGBoFgM6bxEroOJiV1H5yGlI May 26 18:12:28.708051 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Domain-Id: None May 26 18:12:28.708051 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Domain-Name: None May 26 18:12:28.708051 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Identity-Status: Confirmed May 26 18:12:28.708051 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Is-Admin-Project: True May 26 18:12:28.708051 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Domain-Id: default May 26 18:12:28.708051 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Domain-Name: Default May 26 18:12:28.708051 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Id: 5eefb86101fe49f9953595f91d4a790a May 26 18:12:28.708051 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Name: tempest-TestMinimumBasicScenario-140717380 May 26 18:12:28.708051 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Role: member,reader May 26 18:12:28.708051 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Roles: member,reader May 26 18:12:28.709788 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5eefb86101fe49f9953595f91d4a790a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/5eefb86101fe49f9953595f91d4a790a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5eefb86101fe49f9953595f91d4a790a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_5eefb86101fe49f9953595f91d4a790a"}]}] May 26 18:12:28.709788 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant: tempest-TestMinimumBasicScenario-140717380 May 26 18:12:28.709788 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant-Id: 5eefb86101fe49f9953595f91d4a790a May 26 18:12:28.709788 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant-Name: tempest-TestMinimumBasicScenario-140717380 May 26 18:12:28.709788 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User: tempest-TestMinimumBasicScenario-140717380-project May 26 18:12:28.709788 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Domain-Id: default May 26 18:12:28.709788 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Domain-Name: Default May 26 18:12:28.709788 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Id: e6d5c34aba8047e593b32ec34ab7fba9 May 26 18:12:28.709788 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Name: tempest-TestMinimumBasicScenario-140717380-project May 26 18:12:28.709788 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: method: > May 26 18:12:28.709788 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: exception: Instance 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a is not attached to volume e0843336-b4ee-46ab-b3d4-15a603039780 May 26 18:12:28.710901 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: action_args: {'server_id': '7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a', 'id': 'e0843336-b4ee-46ab-b3d4-15a603039780'} May 26 18:12:28.710901 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:12:28.710901 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:12:28.710901 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 26 18:12:28.710901 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 26 18:12:28.710901 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 18:12:28.710901 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 18:12:28.710901 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 26 18:12:28.710901 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 26 18:12:28.710901 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id e0843336-b4ee-46ab-b3d4-15a603039780. May 26 18:12:28.710901 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:12:28.710901 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:12:28.710901 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:12:28.710901 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:12:28.710901 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:12:28.710901 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:12:28.710901 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:12:28.710901 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:12:28.710901 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:12:28.712741 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:12:28.712741 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 26 18:12:28.712741 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 26 18:12:28.712741 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a is not attached to volume e0843336-b4ee-46ab-b3d4-15a603039780 May 26 18:12:28.712741 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:12:28.712741 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:12:28.712741 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:12:28.712741 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:12:28.712741 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:12:28.712741 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:12:28.712741 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:12:28.712741 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:12:28.712741 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a is not attached to volume e0843336-b4ee-46ab-b3d4-15a603039780 May 26 18:12:28.712741 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:12:28.712741 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-a82d4909-62c7-40d2-aac5-17bb7f7215fd tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Returning 404 to user: Instance 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a is not attached to volume e0843336-b4ee-46ab-b3d4-15a603039780 {{(pid=117722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:12:28.714084 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-a82d4909-62c7-40d2-aac5-17bb7f7215fd tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] 10.222.0.69 "DELETE /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a/os-volume_attachments/e0843336-b4ee-46ab-b3d4-15a603039780" status: 404 len: 154 microversion: 2.1 time: 0.162050 May 26 18:12:28.714084 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 570/1115] 10.222.0.69 () {58 vars in 1415 bytes} [Thu May 26 18:12:28 2022] DELETE /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a/os-volume_attachments/e0843336-b4ee-46ab-b3d4-15a603039780 => generated 154 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:12:29.869975 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-a646cbd6-f6ef-4e1c-a2d4-8427bc1a1fd5 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:29.870845 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-a646cbd6-f6ef-4e1c-a2d4-8427bc1a1fd5 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] [instance: 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:29.881679 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a646cbd6-f6ef-4e1c-a2d4-8427bc1a1fd5 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:29.882422 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a646cbd6-f6ef-4e1c-a2d4-8427bc1a1fd5 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:29.883699 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a646cbd6-f6ef-4e1c-a2d4-8427bc1a1fd5 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:29.884865 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a646cbd6-f6ef-4e1c-a2d4-8427bc1a1fd5 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:29.917651 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-a646cbd6-f6ef-4e1c-a2d4-8427bc1a1fd5 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] [instance: 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a] Going to try to terminate instance {{(pid=117723) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:12:30.012877 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-a646cbd6-f6ef-4e1c-a2d4-8427bc1a1fd5 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] 10.222.0.69 "DELETE /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a" status: 204 len: 0 microversion: 2.1 time: 0.149565 May 26 18:12:30.013655 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 546/1116] 10.222.0.69 () {58 vars in 1238 bytes} [Thu May 26 18:12:29 2022] DELETE /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 18:12:30.022224 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-49d3cbbf-8b0c-45a0-9bc9-6a6d085f4ef9 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:30.023052 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-49d3cbbf-8b0c-45a0-9bc9-6a6d085f4ef9 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] [instance: 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:30.031642 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-49d3cbbf-8b0c-45a0-9bc9-6a6d085f4ef9 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:30.032198 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-49d3cbbf-8b0c-45a0-9bc9-6a6d085f4ef9 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:30.033043 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-49d3cbbf-8b0c-45a0-9bc9-6a6d085f4ef9 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:30.033558 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-49d3cbbf-8b0c-45a0-9bc9-6a6d085f4ef9 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:30.203066 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-49d3cbbf-8b0c-45a0-9bc9-6a6d085f4ef9 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d5c34aba8047e593b32ec34ab7fba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eefb86101fe49f9953595f91d4a790a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:30.211700 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-49d3cbbf-8b0c-45a0-9bc9-6a6d085f4ef9 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] 10.222.0.69 "GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a" status: 200 len: 1553 microversion: 2.1 time: 0.192939 May 26 18:12:30.212327 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 571/1117] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:12:30 2022] GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a => generated 1553 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:12:31.231287 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-ebb265f2-3f95-4cd1-89d3-c8dfac867a00 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:31.232141 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-ebb265f2-3f95-4cd1-89d3-c8dfac867a00 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] [instance: 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:31.239481 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ebb265f2-3f95-4cd1-89d3-c8dfac867a00 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:31.239956 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ebb265f2-3f95-4cd1-89d3-c8dfac867a00 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:31.240784 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ebb265f2-3f95-4cd1-89d3-c8dfac867a00 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:31.241234 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ebb265f2-3f95-4cd1-89d3-c8dfac867a00 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:31.393095 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-ebb265f2-3f95-4cd1-89d3-c8dfac867a00 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d5c34aba8047e593b32ec34ab7fba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eefb86101fe49f9953595f91d4a790a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:31.401811 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-ebb265f2-3f95-4cd1-89d3-c8dfac867a00 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] 10.222.0.69 "GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a" status: 200 len: 1553 microversion: 2.1 time: 0.175542 May 26 18:12:31.402441 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 547/1118] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:12:31 2022] GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a => generated 1553 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:12:32.262341 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [req-25fe1c8b-5ab0-4211-b8ab-50463da083b0 req-66a826f7-45a5-4524-90ad-9011626fabc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a", "name": "network-vif-deleted", "tag": "c59057e8-e60b-4afe-bee1-1f39250eb63e"}]} {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:12:32.275273 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-25fe1c8b-5ab0-4211-b8ab-50463da083b0 req-66a826f7-45a5-4524-90ad-9011626fabc7 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:32.275743 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [req-25fe1c8b-5ab0-4211-b8ab-50463da083b0 req-66a826f7-45a5-4524-90ad-9011626fabc7 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:32.304356 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.compute.server_external_events [req-25fe1c8b-5ab0-4211-b8ab-50463da083b0 req-66a826f7-45a5-4524-90ad-9011626fabc7 service nova] Creating event network-vif-deleted:c59057e8-e60b-4afe-bee1-1f39250eb63e for instance 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a on hv-cinder-83607 May 26 18:12:32.313821 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [req-25fe1c8b-5ab0-4211-b8ab-50463da083b0 req-66a826f7-45a5-4524-90ad-9011626fabc7 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056772 May 26 18:12:32.314908 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 572/1119] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:12:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:12:32.419115 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-36046789-ebdb-4958-9faa-dcd3d6c110a5 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:32.419723 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-36046789-ebdb-4958-9faa-dcd3d6c110a5 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] [instance: 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:32.427314 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-36046789-ebdb-4958-9faa-dcd3d6c110a5 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:32.427788 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-36046789-ebdb-4958-9faa-dcd3d6c110a5 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:32.428619 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-36046789-ebdb-4958-9faa-dcd3d6c110a5 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:32.429064 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-36046789-ebdb-4958-9faa-dcd3d6c110a5 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:32.476119 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-36046789-ebdb-4958-9faa-dcd3d6c110a5 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:32.477552 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-36046789-ebdb-4958-9faa-dcd3d6c110a5 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:32.478381 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.objects.instance [None req-36046789-ebdb-4958-9faa-dcd3d6c110a5 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lazy-loading 'fault' on Instance uuid 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a {{(pid=117723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:12:32.530785 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-36046789-ebdb-4958-9faa-dcd3d6c110a5 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d5c34aba8047e593b32ec34ab7fba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eefb86101fe49f9953595f91d4a790a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:32.539652 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-36046789-ebdb-4958-9faa-dcd3d6c110a5 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] 10.222.0.69 "GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a" status: 200 len: 1348 microversion: 2.1 time: 0.123978 May 26 18:12:32.540286 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 548/1120] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:12:32 2022] GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a => generated 1348 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:12:33.559876 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-78b736c1-693e-4b70-8a2e-00de55378b06 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:33.560737 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-78b736c1-693e-4b70-8a2e-00de55378b06 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] [instance: 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:33.567988 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-78b736c1-693e-4b70-8a2e-00de55378b06 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:33.568550 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-78b736c1-693e-4b70-8a2e-00de55378b06 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:33.569391 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-78b736c1-693e-4b70-8a2e-00de55378b06 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:33.569896 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-78b736c1-693e-4b70-8a2e-00de55378b06 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:33.585908 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.wsgi [None req-78b736c1-693e-4b70-8a2e-00de55378b06 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] HTTP exception thrown: Instance 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a could not be found. May 26 18:12:33.589233 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-78b736c1-693e-4b70-8a2e-00de55378b06 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Request method failure captured: May 26 18:12:33.589233 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: request: GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a HTTP/1.1 May 26 18:12:33.589233 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Accept: application/json May 26 18:12:33.589233 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Accept-Encoding: identity May 26 18:12:33.589233 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Connection: close May 26 18:12:33.589233 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Content-Length: 0 May 26 18:12:33.589233 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Content-Type: application/json May 26 18:12:33.589233 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Host: 10.222.0.69 May 26 18:12:33.589233 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Openstack-System-Scope: None May 26 18:12:33.589233 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: User-Agent: python-urllib3/1.26.9 May 26 18:12:33.589233 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Auth-Token: gAAAAABij8KGN3Z-vdbfP_lSh9zLh63JbjAFdVqDydYnP9QKW4XT4Tpa5SjqYRR1wQkP2RcwjUs-YHhFUlRoewjDmW12gfeRHkgNqOTtxGJlZJVT2riLNTbN7hxdBUtboQUnLTpQ8WexXqpcEadOjHKqWyE4QQKsGBoFgM6bxEroOJiV1H5yGlI May 26 18:12:33.589233 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Domain-Id: None May 26 18:12:33.589233 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Domain-Name: None May 26 18:12:33.589233 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Identity-Status: Confirmed May 26 18:12:33.589233 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Is-Admin-Project: True May 26 18:12:33.589233 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Domain-Id: default May 26 18:12:33.589233 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Domain-Name: Default May 26 18:12:33.589233 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Id: 5eefb86101fe49f9953595f91d4a790a May 26 18:12:33.589233 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Name: tempest-TestMinimumBasicScenario-140717380 May 26 18:12:33.589233 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Role: member,reader May 26 18:12:33.589233 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Roles: member,reader May 26 18:12:33.590962 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5eefb86101fe49f9953595f91d4a790a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/5eefb86101fe49f9953595f91d4a790a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5eefb86101fe49f9953595f91d4a790a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_5eefb86101fe49f9953595f91d4a790a"}]}] May 26 18:12:33.590962 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant: tempest-TestMinimumBasicScenario-140717380 May 26 18:12:33.590962 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant-Id: 5eefb86101fe49f9953595f91d4a790a May 26 18:12:33.590962 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant-Name: tempest-TestMinimumBasicScenario-140717380 May 26 18:12:33.590962 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User: tempest-TestMinimumBasicScenario-140717380-project May 26 18:12:33.590962 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Domain-Id: default May 26 18:12:33.590962 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Domain-Name: Default May 26 18:12:33.590962 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Id: e6d5c34aba8047e593b32ec34ab7fba9 May 26 18:12:33.590962 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Name: tempest-TestMinimumBasicScenario-140717380-project May 26 18:12:33.590962 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: method: > May 26 18:12:33.590962 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: exception: Instance 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a could not be found. May 26 18:12:33.590962 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: action_args: {'id': '7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a'} May 26 18:12:33.591830 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:12:33.591830 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:12:33.591830 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:12:33.591830 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:12:33.591830 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:12:33.591830 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:12:33.591830 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:12:33.591830 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:12:33.591830 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:12:33.591830 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:12:33.591830 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a could not be found. May 26 18:12:33.591830 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:12:33.591830 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:12:33.591830 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:12:33.591830 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:12:33.591830 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:12:33.591830 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:12:33.591830 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:12:33.591830 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:12:33.591830 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:12:33.593347 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:12:33.593347 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:12:33.593347 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:12:33.593347 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:12:33.593347 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:12:33.593347 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:12:33.593347 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:12:33.593347 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a could not be found. May 26 18:12:33.593347 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:12:33.593347 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:12:33.593347 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:12:33.593347 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:12:33.593347 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:12:33.593347 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:12:33.593347 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:12:33.593347 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:12:33.593347 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a could not be found. May 26 18:12:33.593347 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:12:33.594766 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-78b736c1-693e-4b70-8a2e-00de55378b06 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Returning 404 to user: Instance 7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a could not be found. {{(pid=117722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:12:33.594766 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-78b736c1-693e-4b70-8a2e-00de55378b06 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] 10.222.0.69 "GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a" status: 404 len: 111 microversion: 2.1 time: 0.036797 May 26 18:12:33.594766 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 573/1121] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:12:33 2022] GET /compute/v2.1/servers/7e92a090-dc88-4bc9-9b9a-2709b3d3fc9a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 18:12:33.604806 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-285d6f40-e0f7-43f2-a440-34b729c48531 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] Calling method '.version_select at 0x7f3ab8bc5dc0>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:33.628124 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-285d6f40-e0f7-43f2-a440-34b729c48531 tempest-TestMinimumBasicScenario-140717380 tempest-TestMinimumBasicScenario-140717380-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1007566241" status: 202 len: 0 microversion: 2.1 time: 0.030731 May 26 18:12:33.629073 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 549/1122] 10.222.0.69 () {58 vars in 1271 bytes} [Thu May 26 18:12:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1007566241 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:13:03.077481 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 18:13:03.078106 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Thu May 26 18:13:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 18:13:10.718918 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-faf2aaa3-774b-4311-b834-31ffdcab109a tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:10.719771 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-faf2aaa3-774b-4311-b834-31ffdcab109a tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: 67300aac-c060-4e11-aab6-635c4a8bba9c] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:10.721725 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_api:SELECT=14 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:10.722414 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG dbcounter [-] [117722] Writing DB stats nova_cell1:SELECT=31,nova_cell1:INSERT=1 {{(pid=117722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:10.722976 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:10.724943 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:10.731635 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-faf2aaa3-774b-4311-b834-31ffdcab109a tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:10.732117 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-faf2aaa3-774b-4311-b834-31ffdcab109a tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:10.733172 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-faf2aaa3-774b-4311-b834-31ffdcab109a tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:10.733616 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-faf2aaa3-774b-4311-b834-31ffdcab109a tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:10.734925 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-65a9f022-b107-4edb-be8d-0ec7f2be71a5 req-c2116719-0497-4e2c-a165-39efbb84e1a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67300aac-c060-4e11-aab6-635c4a8bba9c", "tag": "be659ba1-8698-4fe5-9230-25e1add7adbc"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:13:10.766832 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-65a9f022-b107-4edb-be8d-0ec7f2be71a5 req-c2116719-0497-4e2c-a165-39efbb84e1a3 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:10.767288 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-65a9f022-b107-4edb-be8d-0ec7f2be71a5 req-c2116719-0497-4e2c-a165-39efbb84e1a3 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:10.782490 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-65a9f022-b107-4edb-be8d-0ec7f2be71a5 req-c2116719-0497-4e2c-a165-39efbb84e1a3 service nova] Creating event network-changed:be659ba1-8698-4fe5-9230-25e1add7adbc for instance 67300aac-c060-4e11-aab6-635c4a8bba9c on hv-cinder-83607 May 26 18:13:10.783745 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-faf2aaa3-774b-4311-b834-31ffdcab109a tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: 67300aac-c060-4e11-aab6-635c4a8bba9c] Going to try to terminate instance {{(pid=117722) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:13:10.789543 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-65a9f022-b107-4edb-be8d-0ec7f2be71a5 req-c2116719-0497-4e2c-a165-39efbb84e1a3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068881 May 26 18:13:10.790866 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 550/1123] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:13:10.918390 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-faf2aaa3-774b-4311-b834-31ffdcab109a tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "DELETE /compute/v2.1/servers/67300aac-c060-4e11-aab6-635c4a8bba9c" status: 204 len: 0 microversion: 2.1 time: 0.205111 May 26 18:13:10.919866 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 574/1124] 10.222.0.69 () {58 vars in 1238 bytes} [Thu May 26 18:13:10 2022] DELETE /compute/v2.1/servers/67300aac-c060-4e11-aab6-635c4a8bba9c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 18:13:10.940610 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-229061f2-9047-4251-8db8-72ea10d9e3ba tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:10.942477 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-229061f2-9047-4251-8db8-72ea10d9e3ba tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: 67300aac-c060-4e11-aab6-635c4a8bba9c] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:10.960212 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-229061f2-9047-4251-8db8-72ea10d9e3ba tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:10.961147 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-229061f2-9047-4251-8db8-72ea10d9e3ba tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:10.962712 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-229061f2-9047-4251-8db8-72ea10d9e3ba tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:10.964154 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-229061f2-9047-4251-8db8-72ea10d9e3ba tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:11.158872 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-229061f2-9047-4251-8db8-72ea10d9e3ba tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683ec43ae844757883a7dd5003b53d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a75cf80284f58b9c3bed674677a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:11.168339 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-229061f2-9047-4251-8db8-72ea10d9e3ba tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "GET /compute/v2.1/servers/67300aac-c060-4e11-aab6-635c4a8bba9c" status: 200 len: 1576 microversion: 2.1 time: 0.240913 May 26 18:13:11.168976 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 551/1125] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:13:10 2022] GET /compute/v2.1/servers/67300aac-c060-4e11-aab6-635c4a8bba9c => generated 1576 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:12.193080 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-c1de9730-bfb1-4fa5-b7dd-96e5d8084ac7 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:12.195246 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-c1de9730-bfb1-4fa5-b7dd-96e5d8084ac7 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: 67300aac-c060-4e11-aab6-635c4a8bba9c] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:12.204312 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c1de9730-bfb1-4fa5-b7dd-96e5d8084ac7 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:12.205165 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c1de9730-bfb1-4fa5-b7dd-96e5d8084ac7 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:12.206086 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c1de9730-bfb1-4fa5-b7dd-96e5d8084ac7 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:12.206635 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c1de9730-bfb1-4fa5-b7dd-96e5d8084ac7 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:12.393000 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-c1de9730-bfb1-4fa5-b7dd-96e5d8084ac7 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683ec43ae844757883a7dd5003b53d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a75cf80284f58b9c3bed674677a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:12.403183 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-c1de9730-bfb1-4fa5-b7dd-96e5d8084ac7 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "GET /compute/v2.1/servers/67300aac-c060-4e11-aab6-635c4a8bba9c" status: 200 len: 1576 microversion: 2.1 time: 0.218070 May 26 18:13:12.403984 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 575/1126] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:13:12 2022] GET /compute/v2.1/servers/67300aac-c060-4e11-aab6-635c4a8bba9c => generated 1576 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:12.982901 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-94d4d91c-b9e3-4daf-979a-315c4a95a019 req-decd8f9c-6329-496d-87eb-acc501eb7288 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67300aac-c060-4e11-aab6-635c4a8bba9c", "name": "network-vif-deleted", "tag": "be659ba1-8698-4fe5-9230-25e1add7adbc"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:13:12.994635 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-94d4d91c-b9e3-4daf-979a-315c4a95a019 req-decd8f9c-6329-496d-87eb-acc501eb7288 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:12.996071 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-94d4d91c-b9e3-4daf-979a-315c4a95a019 req-decd8f9c-6329-496d-87eb-acc501eb7288 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:13.009388 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-94d4d91c-b9e3-4daf-979a-315c4a95a019 req-decd8f9c-6329-496d-87eb-acc501eb7288 service nova] Creating event network-vif-deleted:be659ba1-8698-4fe5-9230-25e1add7adbc for instance 67300aac-c060-4e11-aab6-635c4a8bba9c on hv-cinder-83607 May 26 18:13:13.017071 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-94d4d91c-b9e3-4daf-979a-315c4a95a019 req-decd8f9c-6329-496d-87eb-acc501eb7288 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038798 May 26 18:13:13.017741 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 552/1127] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:13:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:13:13.424059 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-c4e8c6a7-2d26-4045-93ca-7b3ebe0c539d tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:13.424935 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-c4e8c6a7-2d26-4045-93ca-7b3ebe0c539d tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: 67300aac-c060-4e11-aab6-635c4a8bba9c] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:13.433082 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c4e8c6a7-2d26-4045-93ca-7b3ebe0c539d tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:13.433721 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c4e8c6a7-2d26-4045-93ca-7b3ebe0c539d tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:13.434707 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c4e8c6a7-2d26-4045-93ca-7b3ebe0c539d tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:13.435240 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c4e8c6a7-2d26-4045-93ca-7b3ebe0c539d tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:13.473605 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c4e8c6a7-2d26-4045-93ca-7b3ebe0c539d tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:13.474002 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-c4e8c6a7-2d26-4045-93ca-7b3ebe0c539d tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:13.474498 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.objects.instance [None req-c4e8c6a7-2d26-4045-93ca-7b3ebe0c539d tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lazy-loading 'fault' on Instance uuid 67300aac-c060-4e11-aab6-635c4a8bba9c {{(pid=117722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:13:13.522262 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-c4e8c6a7-2d26-4045-93ca-7b3ebe0c539d tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683ec43ae844757883a7dd5003b53d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a75cf80284f58b9c3bed674677a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:13.532815 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-c4e8c6a7-2d26-4045-93ca-7b3ebe0c539d tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "GET /compute/v2.1/servers/67300aac-c060-4e11-aab6-635c4a8bba9c" status: 200 len: 1230 microversion: 2.1 time: 0.112751 May 26 18:13:13.533721 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 576/1128] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:13:13 2022] GET /compute/v2.1/servers/67300aac-c060-4e11-aab6-635c4a8bba9c => generated 1230 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:14.553455 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-e0f2a968-4ae2-483b-89f1-4d96b0ccb4d2 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:14.554152 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-e0f2a968-4ae2-483b-89f1-4d96b0ccb4d2 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: 67300aac-c060-4e11-aab6-635c4a8bba9c] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:14.562152 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e0f2a968-4ae2-483b-89f1-4d96b0ccb4d2 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:14.562661 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e0f2a968-4ae2-483b-89f1-4d96b0ccb4d2 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:14.563560 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e0f2a968-4ae2-483b-89f1-4d96b0ccb4d2 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:14.564141 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e0f2a968-4ae2-483b-89f1-4d96b0ccb4d2 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:14.580246 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.wsgi [None req-e0f2a968-4ae2-483b-89f1-4d96b0ccb4d2 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] HTTP exception thrown: Instance 67300aac-c060-4e11-aab6-635c4a8bba9c could not be found. May 26 18:13:14.582153 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-e0f2a968-4ae2-483b-89f1-4d96b0ccb4d2 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Request method failure captured: May 26 18:13:14.582153 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: request: GET /compute/v2.1/servers/67300aac-c060-4e11-aab6-635c4a8bba9c HTTP/1.1 May 26 18:13:14.582153 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Accept: application/json May 26 18:13:14.582153 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Accept-Encoding: identity May 26 18:13:14.582153 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Connection: close May 26 18:13:14.582153 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Content-Length: 0 May 26 18:13:14.582153 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Content-Type: application/json May 26 18:13:14.582153 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Host: 10.222.0.69 May 26 18:13:14.582153 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Openstack-System-Scope: None May 26 18:13:14.582153 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: User-Agent: python-urllib3/1.26.9 May 26 18:13:14.582153 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Auth-Token: gAAAAABij8FyoxciT5YEzji_ZgoA_N96i2J26DPiyFqPfiWqDD3oVYI-hpQmOxkOrQGj00Dd5rApgP97YeMjNWN9mXaywxuTdw5gYJgojEwOxn91Op2W8jTPbeqsh5xoGhad_x0WZe9M01ZEPTHfW6fv_3JVyS0vC-dZ7CmZlsZI-bUtzFR1CvM May 26 18:13:14.582153 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Domain-Id: None May 26 18:13:14.582153 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Domain-Name: None May 26 18:13:14.582153 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Identity-Status: Confirmed May 26 18:13:14.582153 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Is-Admin-Project: True May 26 18:13:14.582153 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Domain-Id: default May 26 18:13:14.582153 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Domain-Name: Default May 26 18:13:14.582153 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Id: ba5a75cf80284f58b9c3bed674677a39 May 26 18:13:14.582153 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Name: tempest-TestVolumeBootPattern-613694807 May 26 18:13:14.582153 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Role: member,reader May 26 18:13:14.582153 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Roles: member,reader May 26 18:13:14.584770 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ba5a75cf80284f58b9c3bed674677a39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ba5a75cf80284f58b9c3bed674677a39"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ba5a75cf80284f58b9c3bed674677a39"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ba5a75cf80284f58b9c3bed674677a39"}]}] May 26 18:13:14.584770 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant: tempest-TestVolumeBootPattern-613694807 May 26 18:13:14.584770 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant-Id: ba5a75cf80284f58b9c3bed674677a39 May 26 18:13:14.584770 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant-Name: tempest-TestVolumeBootPattern-613694807 May 26 18:13:14.584770 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User: tempest-TestVolumeBootPattern-613694807-project May 26 18:13:14.584770 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Domain-Id: default May 26 18:13:14.584770 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Domain-Name: Default May 26 18:13:14.584770 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Id: 9683ec43ae844757883a7dd5003b53d9 May 26 18:13:14.584770 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Name: tempest-TestVolumeBootPattern-613694807-project May 26 18:13:14.584770 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: method: > May 26 18:13:14.584770 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: exception: Instance 67300aac-c060-4e11-aab6-635c4a8bba9c could not be found. May 26 18:13:14.584770 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: action_args: {'id': '67300aac-c060-4e11-aab6-635c4a8bba9c'} May 26 18:13:14.586147 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:13:14.586147 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:13:14.586147 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:13:14.586147 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:13:14.586147 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:13:14.586147 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:13:14.586147 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:13:14.586147 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:13:14.586147 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:13:14.586147 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:13:14.586147 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67300aac-c060-4e11-aab6-635c4a8bba9c could not be found. May 26 18:13:14.586147 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:13:14.586147 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:13:14.586147 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:13:14.586147 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:13:14.586147 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:13:14.586147 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:13:14.586147 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:13:14.586147 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:13:14.586147 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:13:14.588451 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:13:14.588451 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:13:14.588451 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:13:14.588451 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:13:14.588451 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:13:14.588451 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:13:14.588451 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:13:14.588451 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67300aac-c060-4e11-aab6-635c4a8bba9c could not be found. May 26 18:13:14.588451 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:13:14.588451 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:13:14.588451 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:13:14.588451 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:13:14.588451 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:13:14.588451 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:13:14.588451 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:13:14.588451 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:13:14.588451 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67300aac-c060-4e11-aab6-635c4a8bba9c could not be found. May 26 18:13:14.588451 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:13:14.591819 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-e0f2a968-4ae2-483b-89f1-4d96b0ccb4d2 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Returning 404 to user: Instance 67300aac-c060-4e11-aab6-635c4a8bba9c could not be found. {{(pid=117723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:13:14.591819 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-e0f2a968-4ae2-483b-89f1-4d96b0ccb4d2 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "GET /compute/v2.1/servers/67300aac-c060-4e11-aab6-635c4a8bba9c" status: 404 len: 111 microversion: 2.1 time: 0.034493 May 26 18:13:14.591819 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 553/1129] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:13:14 2022] GET /compute/v2.1/servers/67300aac-c060-4e11-aab6-635c4a8bba9c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:13:17.850265 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-fc6db4c5-cd05-4cbe-be15-e26f29405802 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:17.851739 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-fc6db4c5-cd05-4cbe-be15-e26f29405802 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: e8ab62c1-6839-4a58-9dd4-848eed83661c] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:17.852855 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-1e8032c6-15f4-47ff-806b-647a9ecf0fb1 req-a6d3f238-b691-4cf5-8d27-68a1b625babb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8ab62c1-6839-4a58-9dd4-848eed83661c", "tag": "c33d9d21-0d51-4503-906b-480b6fb62472"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:13:17.859148 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-fc6db4c5-cd05-4cbe-be15-e26f29405802 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:17.859704 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-fc6db4c5-cd05-4cbe-be15-e26f29405802 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:17.860602 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-fc6db4c5-cd05-4cbe-be15-e26f29405802 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:17.861105 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-fc6db4c5-cd05-4cbe-be15-e26f29405802 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:17.867686 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-1e8032c6-15f4-47ff-806b-647a9ecf0fb1 req-a6d3f238-b691-4cf5-8d27-68a1b625babb service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:17.871967 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-1e8032c6-15f4-47ff-806b-647a9ecf0fb1 req-a6d3f238-b691-4cf5-8d27-68a1b625babb service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:17.884764 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-1e8032c6-15f4-47ff-806b-647a9ecf0fb1 req-a6d3f238-b691-4cf5-8d27-68a1b625babb service nova] Creating event network-changed:c33d9d21-0d51-4503-906b-480b6fb62472 for instance e8ab62c1-6839-4a58-9dd4-848eed83661c on hv-cinder-83607 May 26 18:13:17.891482 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-1e8032c6-15f4-47ff-806b-647a9ecf0fb1 req-a6d3f238-b691-4cf5-8d27-68a1b625babb service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043924 May 26 18:13:17.891728 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 554/1130] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:13:17.903716 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-fc6db4c5-cd05-4cbe-be15-e26f29405802 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: e8ab62c1-6839-4a58-9dd4-848eed83661c] Going to try to terminate instance {{(pid=117722) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:13:18.002907 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-fc6db4c5-cd05-4cbe-be15-e26f29405802 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "DELETE /compute/v2.1/servers/e8ab62c1-6839-4a58-9dd4-848eed83661c" status: 204 len: 0 microversion: 2.1 time: 0.156606 May 26 18:13:18.007741 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 577/1131] 10.222.0.69 () {58 vars in 1238 bytes} [Thu May 26 18:13:17 2022] DELETE /compute/v2.1/servers/e8ab62c1-6839-4a58-9dd4-848eed83661c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 18:13:18.013443 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-28fb10f1-5bf6-4509-8103-fd854b4576d9 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:18.014404 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-28fb10f1-5bf6-4509-8103-fd854b4576d9 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: e8ab62c1-6839-4a58-9dd4-848eed83661c] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:18.021743 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-28fb10f1-5bf6-4509-8103-fd854b4576d9 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:18.023112 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-28fb10f1-5bf6-4509-8103-fd854b4576d9 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:18.023919 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-28fb10f1-5bf6-4509-8103-fd854b4576d9 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:18.024418 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-28fb10f1-5bf6-4509-8103-fd854b4576d9 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:18.204980 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-28fb10f1-5bf6-4509-8103-fd854b4576d9 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683ec43ae844757883a7dd5003b53d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a75cf80284f58b9c3bed674677a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:18.213181 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-28fb10f1-5bf6-4509-8103-fd854b4576d9 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "GET /compute/v2.1/servers/e8ab62c1-6839-4a58-9dd4-848eed83661c" status: 200 len: 1575 microversion: 2.1 time: 0.204157 May 26 18:13:18.213783 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 555/1132] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:13:18 2022] GET /compute/v2.1/servers/e8ab62c1-6839-4a58-9dd4-848eed83661c => generated 1575 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:13:19.236208 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-e3420fac-59da-44fe-9bf3-54e4de8437a5 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:19.237416 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-e3420fac-59da-44fe-9bf3-54e4de8437a5 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: e8ab62c1-6839-4a58-9dd4-848eed83661c] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:19.244895 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e3420fac-59da-44fe-9bf3-54e4de8437a5 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:19.246043 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e3420fac-59da-44fe-9bf3-54e4de8437a5 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:19.246855 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e3420fac-59da-44fe-9bf3-54e4de8437a5 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:19.247288 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-e3420fac-59da-44fe-9bf3-54e4de8437a5 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:19.459410 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-e3420fac-59da-44fe-9bf3-54e4de8437a5 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683ec43ae844757883a7dd5003b53d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a75cf80284f58b9c3bed674677a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:19.468255 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-e3420fac-59da-44fe-9bf3-54e4de8437a5 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "GET /compute/v2.1/servers/e8ab62c1-6839-4a58-9dd4-848eed83661c" status: 200 len: 1575 microversion: 2.1 time: 0.239881 May 26 18:13:19.468870 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 578/1133] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:13:19 2022] GET /compute/v2.1/servers/e8ab62c1-6839-4a58-9dd4-848eed83661c => generated 1575 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:20.334365 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-8f9868f7-166e-42d3-919c-d9fb62fa2b74 req-29581a19-2a40-4df0-82fe-1885d3012735 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8ab62c1-6839-4a58-9dd4-848eed83661c", "name": "network-vif-deleted", "tag": "c33d9d21-0d51-4503-906b-480b6fb62472"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:13:20.344604 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-8f9868f7-166e-42d3-919c-d9fb62fa2b74 req-29581a19-2a40-4df0-82fe-1885d3012735 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:20.345327 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-8f9868f7-166e-42d3-919c-d9fb62fa2b74 req-29581a19-2a40-4df0-82fe-1885d3012735 service nova] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:20.363684 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-8f9868f7-166e-42d3-919c-d9fb62fa2b74 req-29581a19-2a40-4df0-82fe-1885d3012735 service nova] Creating event network-vif-deleted:c33d9d21-0d51-4503-906b-480b6fb62472 for instance e8ab62c1-6839-4a58-9dd4-848eed83661c on hv-cinder-83607 May 26 18:13:20.370229 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-8f9868f7-166e-42d3-919c-d9fb62fa2b74 req-29581a19-2a40-4df0-82fe-1885d3012735 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.327591 May 26 18:13:20.371053 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 556/1134] 10.222.0.69 () {64 vars in 1317 bytes} [Thu May 26 18:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:13:20.496150 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-33f0dcc5-7c31-4817-9b6a-170ab8b65c93 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:20.497133 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-33f0dcc5-7c31-4817-9b6a-170ab8b65c93 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: e8ab62c1-6839-4a58-9dd4-848eed83661c] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:20.508822 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-33f0dcc5-7c31-4817-9b6a-170ab8b65c93 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:20.509382 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-33f0dcc5-7c31-4817-9b6a-170ab8b65c93 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:20.510294 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-33f0dcc5-7c31-4817-9b6a-170ab8b65c93 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:20.511366 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-33f0dcc5-7c31-4817-9b6a-170ab8b65c93 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:20.547540 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-33f0dcc5-7c31-4817-9b6a-170ab8b65c93 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:20.548000 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-33f0dcc5-7c31-4817-9b6a-170ab8b65c93 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:20.548489 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.objects.instance [None req-33f0dcc5-7c31-4817-9b6a-170ab8b65c93 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lazy-loading 'fault' on Instance uuid e8ab62c1-6839-4a58-9dd4-848eed83661c {{(pid=117722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:13:20.595139 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.policy [None req-33f0dcc5-7c31-4817-9b6a-170ab8b65c93 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9683ec43ae844757883a7dd5003b53d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a75cf80284f58b9c3bed674677a39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117722) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:20.603289 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-33f0dcc5-7c31-4817-9b6a-170ab8b65c93 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "GET /compute/v2.1/servers/e8ab62c1-6839-4a58-9dd4-848eed83661c" status: 200 len: 1229 microversion: 2.1 time: 0.113614 May 26 18:13:20.603894 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 579/1135] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:13:20 2022] GET /compute/v2.1/servers/e8ab62c1-6839-4a58-9dd4-848eed83661c => generated 1229 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:21.622989 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-31dad353-7174-4aa1-bb33-cb4100c08e36 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:21.623682 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-31dad353-7174-4aa1-bb33-cb4100c08e36 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: e8ab62c1-6839-4a58-9dd4-848eed83661c] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:21.630516 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-31dad353-7174-4aa1-bb33-cb4100c08e36 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:21.630969 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-31dad353-7174-4aa1-bb33-cb4100c08e36 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:21.631773 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-31dad353-7174-4aa1-bb33-cb4100c08e36 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:21.632280 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-31dad353-7174-4aa1-bb33-cb4100c08e36 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:21.649049 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.wsgi [None req-31dad353-7174-4aa1-bb33-cb4100c08e36 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] HTTP exception thrown: Instance e8ab62c1-6839-4a58-9dd4-848eed83661c could not be found. May 26 18:13:21.650722 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-31dad353-7174-4aa1-bb33-cb4100c08e36 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Request method failure captured: May 26 18:13:21.650722 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: request: GET /compute/v2.1/servers/e8ab62c1-6839-4a58-9dd4-848eed83661c HTTP/1.1 May 26 18:13:21.650722 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Accept: application/json May 26 18:13:21.650722 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Accept-Encoding: identity May 26 18:13:21.650722 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Connection: close May 26 18:13:21.650722 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Content-Length: 0 May 26 18:13:21.650722 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Content-Type: application/json May 26 18:13:21.650722 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Host: 10.222.0.69 May 26 18:13:21.650722 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Openstack-System-Scope: None May 26 18:13:21.650722 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: User-Agent: python-urllib3/1.26.9 May 26 18:13:21.650722 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Auth-Token: gAAAAABij8FyoxciT5YEzji_ZgoA_N96i2J26DPiyFqPfiWqDD3oVYI-hpQmOxkOrQGj00Dd5rApgP97YeMjNWN9mXaywxuTdw5gYJgojEwOxn91Op2W8jTPbeqsh5xoGhad_x0WZe9M01ZEPTHfW6fv_3JVyS0vC-dZ7CmZlsZI-bUtzFR1CvM May 26 18:13:21.650722 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Domain-Id: None May 26 18:13:21.650722 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Domain-Name: None May 26 18:13:21.650722 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Identity-Status: Confirmed May 26 18:13:21.650722 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Is-Admin-Project: True May 26 18:13:21.650722 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Domain-Id: default May 26 18:13:21.650722 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Domain-Name: Default May 26 18:13:21.650722 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Id: ba5a75cf80284f58b9c3bed674677a39 May 26 18:13:21.650722 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Name: tempest-TestVolumeBootPattern-613694807 May 26 18:13:21.650722 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Role: member,reader May 26 18:13:21.650722 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Roles: member,reader May 26 18:13:21.652567 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ba5a75cf80284f58b9c3bed674677a39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ba5a75cf80284f58b9c3bed674677a39"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ba5a75cf80284f58b9c3bed674677a39"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ba5a75cf80284f58b9c3bed674677a39"}]}] May 26 18:13:21.652567 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant: tempest-TestVolumeBootPattern-613694807 May 26 18:13:21.652567 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant-Id: ba5a75cf80284f58b9c3bed674677a39 May 26 18:13:21.652567 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant-Name: tempest-TestVolumeBootPattern-613694807 May 26 18:13:21.652567 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User: tempest-TestVolumeBootPattern-613694807-project May 26 18:13:21.652567 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Domain-Id: default May 26 18:13:21.652567 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Domain-Name: Default May 26 18:13:21.652567 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Id: 9683ec43ae844757883a7dd5003b53d9 May 26 18:13:21.652567 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Name: tempest-TestVolumeBootPattern-613694807-project May 26 18:13:21.652567 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: method: > May 26 18:13:21.652567 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: exception: Instance e8ab62c1-6839-4a58-9dd4-848eed83661c could not be found. May 26 18:13:21.652567 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: action_args: {'id': 'e8ab62c1-6839-4a58-9dd4-848eed83661c'} May 26 18:13:21.653461 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:13:21.653461 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:13:21.653461 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:13:21.653461 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:13:21.653461 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:13:21.653461 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:13:21.653461 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:13:21.653461 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:13:21.653461 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:13:21.653461 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:13:21.653461 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8ab62c1-6839-4a58-9dd4-848eed83661c could not be found. May 26 18:13:21.653461 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:13:21.653461 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:13:21.653461 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:13:21.653461 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:13:21.653461 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:13:21.653461 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:13:21.653461 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:13:21.653461 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:13:21.653461 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:13:21.654985 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:13:21.654985 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:13:21.654985 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:13:21.654985 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:13:21.654985 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:13:21.654985 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:13:21.654985 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:13:21.654985 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8ab62c1-6839-4a58-9dd4-848eed83661c could not be found. May 26 18:13:21.654985 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:13:21.654985 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:13:21.654985 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:13:21.654985 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:13:21.654985 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:13:21.654985 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:13:21.654985 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:13:21.654985 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:13:21.654985 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8ab62c1-6839-4a58-9dd4-848eed83661c could not be found. May 26 18:13:21.654985 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:13:21.656538 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-31dad353-7174-4aa1-bb33-cb4100c08e36 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Returning 404 to user: Instance e8ab62c1-6839-4a58-9dd4-848eed83661c could not be found. {{(pid=117723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:13:21.656538 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-31dad353-7174-4aa1-bb33-cb4100c08e36 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "GET /compute/v2.1/servers/e8ab62c1-6839-4a58-9dd4-848eed83661c" status: 404 len: 111 microversion: 2.1 time: 0.034778 May 26 18:13:21.656538 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 557/1136] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:13:21 2022] GET /compute/v2.1/servers/e8ab62c1-6839-4a58-9dd4-848eed83661c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:13:22.143215 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-1fc12aa8-83e9-4561-8711-a8160e4067e9 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:22.143803 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.compute.api [None req-1fc12aa8-83e9-4561-8711-a8160e4067e9 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: 8c73af69-886c-4f22-a6d3-001f566d3277] Fetching instance by UUID {{(pid=117722) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:22.150197 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-1fc12aa8-83e9-4561-8711-a8160e4067e9 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:22.150642 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-1fc12aa8-83e9-4561-8711-a8160e4067e9 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:22.151410 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-1fc12aa8-83e9-4561-8711-a8160e4067e9 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:22.151933 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG oslo_concurrency.lockutils [None req-1fc12aa8-83e9-4561-8711-a8160e4067e9 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:22.165822 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.wsgi [None req-1fc12aa8-83e9-4561-8711-a8160e4067e9 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] HTTP exception thrown: Instance 8c73af69-886c-4f22-a6d3-001f566d3277 could not be found. May 26 18:13:22.167657 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-1fc12aa8-83e9-4561-8711-a8160e4067e9 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Request method failure captured: May 26 18:13:22.167657 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: request: DELETE /compute/v2.1/servers/8c73af69-886c-4f22-a6d3-001f566d3277 HTTP/1.1 May 26 18:13:22.167657 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Accept: application/json May 26 18:13:22.167657 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Accept-Encoding: identity May 26 18:13:22.167657 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Connection: close May 26 18:13:22.167657 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Content-Length: 0 May 26 18:13:22.167657 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Content-Type: application/json May 26 18:13:22.167657 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Host: 10.222.0.69 May 26 18:13:22.167657 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Openstack-System-Scope: None May 26 18:13:22.167657 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: User-Agent: python-urllib3/1.26.9 May 26 18:13:22.167657 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Auth-Token: gAAAAABij8FyoxciT5YEzji_ZgoA_N96i2J26DPiyFqPfiWqDD3oVYI-hpQmOxkOrQGj00Dd5rApgP97YeMjNWN9mXaywxuTdw5gYJgojEwOxn91Op2W8jTPbeqsh5xoGhad_x0WZe9M01ZEPTHfW6fv_3JVyS0vC-dZ7CmZlsZI-bUtzFR1CvM May 26 18:13:22.167657 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Domain-Id: None May 26 18:13:22.167657 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Domain-Name: None May 26 18:13:22.167657 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Identity-Status: Confirmed May 26 18:13:22.167657 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Is-Admin-Project: True May 26 18:13:22.167657 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Domain-Id: default May 26 18:13:22.167657 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Domain-Name: Default May 26 18:13:22.167657 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Id: ba5a75cf80284f58b9c3bed674677a39 May 26 18:13:22.167657 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Project-Name: tempest-TestVolumeBootPattern-613694807 May 26 18:13:22.167657 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Role: member,reader May 26 18:13:22.167657 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Roles: member,reader May 26 18:13:22.170192 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ba5a75cf80284f58b9c3bed674677a39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ba5a75cf80284f58b9c3bed674677a39"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ba5a75cf80284f58b9c3bed674677a39"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ba5a75cf80284f58b9c3bed674677a39"}]}] May 26 18:13:22.170192 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant: tempest-TestVolumeBootPattern-613694807 May 26 18:13:22.170192 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant-Id: ba5a75cf80284f58b9c3bed674677a39 May 26 18:13:22.170192 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-Tenant-Name: tempest-TestVolumeBootPattern-613694807 May 26 18:13:22.170192 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User: tempest-TestVolumeBootPattern-613694807-project May 26 18:13:22.170192 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Domain-Id: default May 26 18:13:22.170192 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Domain-Name: Default May 26 18:13:22.170192 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Id: 9683ec43ae844757883a7dd5003b53d9 May 26 18:13:22.170192 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: X-User-Name: tempest-TestVolumeBootPattern-613694807-project May 26 18:13:22.170192 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: method: > May 26 18:13:22.170192 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: exception: Instance 8c73af69-886c-4f22-a6d3-001f566d3277 could not be found. May 26 18:13:22.170192 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: action_args: {'id': '8c73af69-886c-4f22-a6d3-001f566d3277'} May 26 18:13:22.171586 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:13:22.171586 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:13:22.171586 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:13:22.171586 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:13:22.171586 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:13:22.171586 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:13:22.171586 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:13:22.171586 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:13:22.171586 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:13:22.171586 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:13:22.171586 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c73af69-886c-4f22-a6d3-001f566d3277 could not be found. May 26 18:13:22.171586 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:13:22.171586 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:13:22.171586 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:13:22.171586 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:13:22.171586 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:13:22.171586 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:13:22.171586 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:13:22.171586 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:13:22.171586 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:13:22.174149 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:13:22.174149 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 18:13:22.174149 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 18:13:22.174149 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 18:13:22.174149 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 18:13:22.174149 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:13:22.174149 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:13:22.174149 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:13:22.174149 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:13:22.174149 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c73af69-886c-4f22-a6d3-001f566d3277 could not be found. May 26 18:13:22.174149 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:13:22.174149 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:13:22.174149 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:13:22.174149 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:13:22.174149 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:13:22.174149 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:13:22.174149 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:13:22.174149 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:13:22.174149 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c73af69-886c-4f22-a6d3-001f566d3277 could not be found. May 26 18:13:22.174149 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: ERROR nova.api.openstack.wsgi May 26 18:13:22.177429 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-1fc12aa8-83e9-4561-8711-a8160e4067e9 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Returning 404 to user: Instance 8c73af69-886c-4f22-a6d3-001f566d3277 could not be found. {{(pid=117722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:13:22.177429 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-1fc12aa8-83e9-4561-8711-a8160e4067e9 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "DELETE /compute/v2.1/servers/8c73af69-886c-4f22-a6d3-001f566d3277" status: 404 len: 111 microversion: 2.1 time: 0.029895 May 26 18:13:22.177429 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 580/1137] 10.222.0.69 () {58 vars in 1238 bytes} [Thu May 26 18:13:22 2022] DELETE /compute/v2.1/servers/8c73af69-886c-4f22-a6d3-001f566d3277 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:13:22.184720 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-73b90100-c9ee-445a-960e-914b5f6dc676 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:22.185895 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-73b90100-c9ee-445a-960e-914b5f6dc676 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] [instance: 8c73af69-886c-4f22-a6d3-001f566d3277] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:22.195687 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-73b90100-c9ee-445a-960e-914b5f6dc676 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:22.196481 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-73b90100-c9ee-445a-960e-914b5f6dc676 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:22.197795 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-73b90100-c9ee-445a-960e-914b5f6dc676 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:22.199157 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-73b90100-c9ee-445a-960e-914b5f6dc676 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Lock "31d4fadf-23db-42ac-9fc1-5cb2101b75d4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:22.224245 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.wsgi [None req-73b90100-c9ee-445a-960e-914b5f6dc676 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] HTTP exception thrown: Instance 8c73af69-886c-4f22-a6d3-001f566d3277 could not be found. May 26 18:13:22.227192 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-73b90100-c9ee-445a-960e-914b5f6dc676 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Request method failure captured: May 26 18:13:22.227192 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: request: GET /compute/v2.1/servers/8c73af69-886c-4f22-a6d3-001f566d3277 HTTP/1.1 May 26 18:13:22.227192 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Accept: application/json May 26 18:13:22.227192 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Accept-Encoding: identity May 26 18:13:22.227192 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Connection: close May 26 18:13:22.227192 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Content-Length: 0 May 26 18:13:22.227192 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Content-Type: application/json May 26 18:13:22.227192 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Host: 10.222.0.69 May 26 18:13:22.227192 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Openstack-System-Scope: None May 26 18:13:22.227192 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: User-Agent: python-urllib3/1.26.9 May 26 18:13:22.227192 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Auth-Token: gAAAAABij8FyoxciT5YEzji_ZgoA_N96i2J26DPiyFqPfiWqDD3oVYI-hpQmOxkOrQGj00Dd5rApgP97YeMjNWN9mXaywxuTdw5gYJgojEwOxn91Op2W8jTPbeqsh5xoGhad_x0WZe9M01ZEPTHfW6fv_3JVyS0vC-dZ7CmZlsZI-bUtzFR1CvM May 26 18:13:22.227192 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Domain-Id: None May 26 18:13:22.227192 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Domain-Name: None May 26 18:13:22.227192 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Identity-Status: Confirmed May 26 18:13:22.227192 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Is-Admin-Project: True May 26 18:13:22.227192 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Domain-Id: default May 26 18:13:22.227192 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Domain-Name: Default May 26 18:13:22.227192 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Id: ba5a75cf80284f58b9c3bed674677a39 May 26 18:13:22.227192 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Project-Name: tempest-TestVolumeBootPattern-613694807 May 26 18:13:22.227192 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Role: member,reader May 26 18:13:22.227192 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Roles: member,reader May 26 18:13:22.228915 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ba5a75cf80284f58b9c3bed674677a39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/ba5a75cf80284f58b9c3bed674677a39"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/ba5a75cf80284f58b9c3bed674677a39"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_ba5a75cf80284f58b9c3bed674677a39"}]}] May 26 18:13:22.228915 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant: tempest-TestVolumeBootPattern-613694807 May 26 18:13:22.228915 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant-Id: ba5a75cf80284f58b9c3bed674677a39 May 26 18:13:22.228915 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-Tenant-Name: tempest-TestVolumeBootPattern-613694807 May 26 18:13:22.228915 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User: tempest-TestVolumeBootPattern-613694807-project May 26 18:13:22.228915 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Domain-Id: default May 26 18:13:22.228915 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Domain-Name: Default May 26 18:13:22.228915 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Id: 9683ec43ae844757883a7dd5003b53d9 May 26 18:13:22.228915 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: X-User-Name: tempest-TestVolumeBootPattern-613694807-project May 26 18:13:22.228915 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: method: > May 26 18:13:22.228915 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: exception: Instance 8c73af69-886c-4f22-a6d3-001f566d3277 could not be found. May 26 18:13:22.228915 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: action_args: {'id': '8c73af69-886c-4f22-a6d3-001f566d3277'} May 26 18:13:22.230317 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:13:22.230317 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:13:22.230317 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:13:22.230317 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:13:22.230317 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:13:22.230317 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:13:22.230317 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:13:22.230317 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:13:22.230317 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:13:22.230317 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:13:22.230317 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c73af69-886c-4f22-a6d3-001f566d3277 could not be found. May 26 18:13:22.230317 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:13:22.230317 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:13:22.230317 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:13:22.230317 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:13:22.230317 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:13:22.230317 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:13:22.230317 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:13:22.230317 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:13:22.230317 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:13:22.231991 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:13:22.231991 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:13:22.231991 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:13:22.231991 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:13:22.231991 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:13:22.231991 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:13:22.231991 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:13:22.231991 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c73af69-886c-4f22-a6d3-001f566d3277 could not be found. May 26 18:13:22.231991 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:13:22.231991 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:13:22.231991 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:13:22.231991 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:13:22.231991 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:13:22.231991 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:13:22.231991 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:13:22.231991 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:13:22.231991 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c73af69-886c-4f22-a6d3-001f566d3277 could not be found. May 26 18:13:22.231991 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 18:13:22.233450 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-73b90100-c9ee-445a-960e-914b5f6dc676 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Returning 404 to user: Instance 8c73af69-886c-4f22-a6d3-001f566d3277 could not be found. {{(pid=117723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:13:22.233450 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-73b90100-c9ee-445a-960e-914b5f6dc676 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "GET /compute/v2.1/servers/8c73af69-886c-4f22-a6d3-001f566d3277" status: 404 len: 111 microversion: 2.1 time: 0.053753 May 26 18:13:22.233450 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 558/1138] 10.222.0.69 () {58 vars in 1235 bytes} [Thu May 26 18:13:22 2022] GET /compute/v2.1/servers/8c73af69-886c-4f22-a6d3-001f566d3277 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:13:23.557546 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: DEBUG nova.api.openstack.wsgi [None req-07677965-10f0-4828-9497-822276d604b5 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] Calling method '.version_select at 0x7f3ab8ecbe50>' {{(pid=117722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:23.590085 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO nova.api.openstack.requestlog [None req-07677965-10f0-4828-9497-822276d604b5 tempest-TestVolumeBootPattern-613694807 tempest-TestVolumeBootPattern-613694807-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-388820237" status: 202 len: 0 microversion: 2.1 time: 0.039049 May 26 18:13:23.590421 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: [pid: 117722|app: 0|req: 581/1139] 10.222.0.69 () {58 vars in 1259 bytes} [Thu May 26 18:13:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-388820237 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:15:03.491774 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 18:15:03.492485 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Thu May 26 18:15:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 18:15:52.578531 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 18:15:52.579322 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Thu May 26 18:15:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 18:16:19.444878 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 18:16:19.445474 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Thu May 26 18:16:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 18:16:23.087536 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 18:16:23.088260 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Thu May 26 18:16:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 18:16:36.605641 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 18:16:36.606408 dv-cinder-836074-5-iscsi devstack@n-api.service[117722]: Thu May 26 18:16:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 18:18:23.500176 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 18:18:23.500790 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Thu May 26 18:18:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 18:18:29.902851 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 18:18:29.903556 dv-cinder-836074-5-iscsi devstack@n-api.service[117723]: Thu May 26 18:18:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!